For  Reference 


NOT  TO  BE  TAKEN  FROM  THIS  ROOM 


©X  UBJH6 

Httmamis 


University  oj  Alberta 
Printing  Department 


Digitized  by  the  Internet  Archive 
in  2018  with  funding  from 
University  of  Alberta  Libraries 


https  ://arch  i  ve .  org/detai  Is/H  u  i  1 961 


THE  UNIVERSITY  OF  ALBERTA 


MOMENT  GENERATING  FUNCTIONAL  EQUATIONS 
OF  CERTAIN  STOCHASTIC  LEARNING  MODELS 


A  THESIS 

SUBMITTED  TO  THE  FACULTY  OF  GRADUATE  STUDIES 
IN  PARTIAL  FULFILMENT  OF  THE  REQUIREMENTS  FOR  THE  DECREE 
OF  MASTER  OF  SCIENCE 


DEPARTMENT  OF  MATHEMATICS 


by 


Yin  Yew  Hui 


EDMONTON,  ALBERTA 


August,  1961 


abstract 


This  thesis  deals  with  the  derivation  of  the  moment 
generating  functional  equations  of  certain  stochastic  learning 
models  and  the  solution  of  them  in  some  special  cases.  The 
first  chapter  reviews  the  relevant  materials  in  Bush  and 
Hosteller1 s  “Stochastic  Models  for  Learning"  [l]  .  The  second 
chapter  deals  with  the  derivation  of  the  asymptotic  moment 
generating  functional  equations  of  the  two  experimenter- 
controlled  events  model  and  of  the  two  subject-controlled 
events  model.  The  third  chapter  deals  with  the  solution  of 
these  equations  in  some  special  cases  and  the  inversion  of  the 


solutions  into  distribution  functions 
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CHAPTER  I 

SUMMARY  OF  THE  RELEVANT  LITERATURE  ON 
STOCHASTIC  LEARNING  MODELS 

In  this  introductory  chapter,  the  work  of  Robert  R. 

Bush  and  Frederick  Mosteller  (l)  which  is  directly  related  to 
the  present  thesis  is  discussed.  This  chapter  deals  with  the 
description  and  some  of  the  mathematics  of  the  Bush-Mos teller 
learning  models  of  experimenter-controlled  and  subject-controlled 
events.  It  is  divided  into  three  sections.  Section  one  gives 
the  description  and  the  mathematics  common  to  both  models;  section 
two  deals  with  experimenter-controlled  events  and  section  three 
deals  with  subject-controlled  events. 

Section  One 

The  behavioural  changes  of  learning  are  described  here 
in  terms  of  responses.  In  general,  consider  an  experiment 
involving  r  mutually  exclusive  and  exhaustive  responses  denoted 
by  A  where  j  *  1,  2,  ...r.  Each  of  these  r  responses  has 

J 

a  certain  probability  of  occurring  and  we  represent  each  of  these 
probabilities  by  p^  where  j  =  1,  2,  ...r  respectively. 

Since  the  responses  are  exhaustive  and  mutually  exclusive,  the 
probability  invariance  rule  holds,  i.e. 

r 

(l.l.l)  2  p..  *  1  and  0  <  p.  <  1  . 

j«l  J  ~ 


. 

■  1  '  ■  '  ■  > 
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v  '  '  ■ :  ■  r  -  ’  ■  ■■•  '  :  ’■ ■  ■  ■.  '  ■  ■  .  r 


'  I'Li 


.  >■ 
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For  two  exhaustive  and  mutually  exclusive  responses, 

2 

(1.1.2)  2  “  P,  ♦  P«  “  1  . 

The  probabilities  of  the  occurrences  of  the  responses, 
however,  do  not  necessarily  remain  constant;  in  the  learning 
process,  the  occurrence  of  a  certain  event  in  the  process  will 
in  general  alter  the  probabilities  of  responses  pj  in  the  next 
trial  in  a  certain  way.  Let  there  be  t  exhaustive  and  mutually 
exclusive  events  in  each  trial  of  the  process  and  let  these  events 
be  denoted  by  (where  i  3  1,  2,  ...  t)  .  In  fact,  we  are 
assuming  that  every  time  a  response  is  made,  an  outcome  follows, 
and  the  outcome  will  alter  the  probabilities  ©f  the  responses  in 
a  certain  way. 

To  put  the  above  in  another  way,  a  learning  experiment 
consists  of  a  sequence  of  trials,  on  each  of  which  one  and  only 
one  response  occurs.  Each  response  occurrence  has  an  outcome 
which  alters  the  set  of  probabilities  of  the  responses  on  the 
next  trial. 


To  describe  the  effects  of  the  events  on  the  set  of 

probabilities  of  responses,  we  make  use  of  the  concept  of  an 

operator.  Let  the  set  of  r  probabilities  be  represented  by  a 

r 

column  vector  £  ■  (px  p2  ...  pr)  *  with  2  p.j  -  1  ,  and 

3=1 

define  a  matrix  operator  T^  for  each  of  the  t  events  where 
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(1.1.3)  T±  - 


-  3  - 

Un,i 

ui2,i 

U21,i 

^22, i  •• 

• 

O' 

• 

uri,i 

ur2,i  •• 

...  urrjiy 

and  i  »  1,  2,  ...  t 


When  the  matrix  operator  is  applied  to  the  probability  vector 
p  ,  a  new  probability  vector 
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(1.1.10  Ti  £ 


un,i 

U2i,i 


Ul2,i 


U22,i 


z.  0^,ip3 

J  • 


V 


*  Urj,  Pj 
0 


Uir,i 

U2r,i 


\ 


pi 

P2 


\ 


Urr,i/  \Pr 


/ 


where  i  ■  1,  2,  ...  t 
j  *  1,  2,  ...  r 


is  obtained. 

Since  T.  p  is  a  new  probability  vector. 


r  r 

2  2  Uk1  p^  *  1 

k»l  j-1  ***  J 


where  (i  *  1,  2,  ...  t) 


Pj 


for  all  values  of 


f 


y.\ 


. 


f 

/ 


i 


-  h  - 


Consider  the  case  where  px  ■  1  ,  then  Pj  *  0 
for  j  «  2,  3,  ...  r  ,  and  so 


r 


*  &kl  -  1  ,  i-e- 

k»l 


where  the  subscript  i  has  been  dropped  for  simplicity.  Thus 
by  letting  Pj  *  1  for  J  *  1,  2,  ,,,  r  respectively,  it  can 
be  established  that  each  column  of  the  matrix  must  sum  to 
unity, 

r 

(1.1,5)  i.e.  2  U..  *  1  for  j  s  1,  2,  ...  r  . 
k*l 

Since  the  r  classes  of  responses  are  arbitrarily 
defined,  it  should  be  mathematically  possible  to  combine  two 
classes  of  responses  into  one  and  to  arrive  at  the  same  result 
as  if  we  started  off  with  r  -  1  classes.  Consider  the  case 
where  we  want  to  combine  classes  one  and  two  into  a  new  class. 
This  can  be  done  by  multiplying  the  vector  p  by  the  r  %  r 
matrix  c  where 


1  0 


•  •  • 


0  \ 


(1.1.6)  c  -  0  0  0  ...  0 


0  0  1 


•  •  # 
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0  0  0 
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Since 


"ljPj 

°2j  pj 
U3j  Pj 


pj 


where  i  »  1,  2,  ...  t 

j  »  1,  2,  ...  r  , 


it  follows  that 


Since  we  require  that  classes  one  and  two  combine  to  form  a  new 

class  with  probability  pc  *  px  +  p2  ,  the  components  of  the 

vector  c  (T^  p)  must  not  depend  on  px  and  p2  individually 

but  on  p  =  p  p  and  so 
c  *  ^ 


U31  “  °32  *  u3 
%L  -  %  - 

uri  -  ur2  *  ur  , 


say 


-  6  - 


Since  every  column  vector  of  must  sum  to  1  , 


In  a  similar  way,  by  combining  classes  one  and  three 
of  the  responses  into  one,  it  can  be  shovm  that 


~  U22  *  U2  /  say. 


Thus 


U11  "  1  “  U2  -  U3  -ur  » 


and  the  first  column  of  Tj  is 


1  -  U2  -  U3  ...  -  Ur 
IL 


u. 


u 


r 


Similarly  by  combining  classes  two  and  three  we  obtain 


ui2  ■  °i3  *  Di  ,  say> 


- 


; 


. 


and  thus  the  second  column  of  Tj  is 


U. 


By  using  this  method  it  can  be  shown  that 


(1.1.8)  T± 


i-u2-u3...-ur 


U 


% 


•  •  •  Un 


1-Un-U^-U,....-Ur  ...  U2 


1“  3”  4* 

u„ 


u 


u 


il 


...  l-U1-U2...-TJr„i 


/I  0  0  —  O' 

lh 

0  1  0  ...  0 

1 

I'z 

0  0  1  ...  0 

°3 

. 1 

\0  0  0  ...  1 J 

\u 

-  8  - 


Let 


1  «  Ux  •  Ug  -  U3  «  •  •  •  ■  Uj,  ®  1  “  Z  Uj  f 

j"i 

*  (l  -  au)  Aj  ,  where  j  »  1,  2,  ...  r  . 


Then 

/I  0  ...  0\ 

(1.1.9)  -  aA 

0  1  ...  0 

•  •••••  f 

( 

4> 

\o  0  ...  1/ 

l 

and  if  we  put 

I 

Ax  \ 

•  •  • 

Ax\ 

(1.1.10)  / 

TVa  Aa  •  •  • 

Ax  \ 

1 

^Ar  Ar 

Ar/ 

(1-aDA*  (1-^  ...  (1-aXA 

(1-c QAZ  (1  -cQ\  ...  (l-^ 


(l-cQA*.  (l-a^Vr 


...  (i—cQAj,  j 


then 


(1.1.11)  T*  -  +  (1  -  Oi)  A-i 


and 


Ai\ 

(X.1.12)AiP  =  |  JV; 


A; 


rl 


-  9  - 


Thus 

(1.1.13)  T.  p  »  a.  I  p  +  (l  -  ai)Ai  E 
=  ai  P  +  (1  -  )X* 


Therefore,  for  the  case  r  »  2 


i  *  1,  2  ...  t  , 


/  1  -  Uai  U1±  ' 
(  U2i  1-U1± 


Let 


U 


li 


a. 

x 


9 


where  p  +  q  ~  1  ,  and  so  -  1  -  -  b^ 


Then 


(l.l.lU)  T± 


1  ** 

bi  1  “  ai 


and 


(1.1.15)  T ,  p  - 


(1  -  b±)p  +  a±  q  \  /  Qi  p' 

b±  p  +  (l  -  ai)q /  \Q±  q 


where  p  *  (l  -  b^p  +  ai  q 

Qi  q  -  b±  p  4-  (1  -  ai)q 


i  -  1,  2  ...  t  . 


By  rearranging  the  terms  on  the  right  hand  side,  the  following  forms 
for  Q±  p  are  obtained 

(a)  SLOPE- INTERCEPT  FORM: 


(1.1.16)  Qi  P  ®  ai  +  “i  p 


where 


i  =  i,  2...r, 


a  .. 


&  , 


. 


.  )  . 


•  “ 


vf 


- 


. 


;T: 


l 


-  10  - 


(b)  GAIN-LOSS  FORMS 

(1*1.17)  Qi  P  *  P  +  ai(l  -  p)  -  bj  p  where  i  *  1,  2, .  . .  t 


(c)  FIXED-POINT  FORM: 

(1.1.18)  Qi  p  =  p  +  (l  -  where  i  ■  1,  2  ...  t 

Since  q  «  1  »  p  ,  by  the  fixed-point  form  , 

Qi  q  s  ai  q  +  (l  -  a^Kl  -A^) 


Dropping  the  subscript  1  in  A.^  ,  we  have 


(1.1.19)  Si  P  =  | 

I* i  P\ 

+ 

'  (i  - 

[\  q j 

* 

1(1  -  ajHl  -\±)j 

• 

f“iP' 

+  ( 

(1  -  ai)\i 
{(1  -  a±)(l  -  Xi) 

H 


\Q, 


*  (i  -  “i> 


Ki 


"  ai  p  ♦ 


(!  - 


As  p  and  p  both  have  to  satisfy  the  relations  0  <  p  <  1 
0  <  p  <  1  ,  the  parameters  a^  ,  bj[  and  have  to  obey  certain 


restrictions 


■  t 


"  \  .  !■ 


'  ... 


!  ■ 


■:y  r  r  ;'f  | 

''  '  ;  > 


‘ 
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Consider  the  gain-loss  form, 

Qi  P  “  P  +  ai(l  -  p)  -  p  . 


Since  0  <  p  <  1  it  follows  that 

(1.1.20)  0  <  p  +  ai(l  -  p)  -  p  <  1  • 

Let  p  s  0  ,  then  the  relation 

(1.1.21)  0  <  Q±  p  <  1  becomes  0  <  <  1  . 


For 


p  -  1  ,  the  relation  0  <  p  <  1  becomes 


(1.1.22)  0  <  1  =>  b^  <  1  or  1  >  bf  >  0  . 

Hence  the  admissible  region  for  a^  and  bj_  is  shown  by  the 
shaded  part  of  figure  1.1  . 


Fig.  1.1  A  plot  showing  restrictions  on  the  parameters 
ai  and  b^  .  The  square  shaded  area  repre¬ 
sents  the  admissible  region.  (Reproduced  from 
(l)  page  3U  ) 


_  '  '  ■  ;  . 
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Since  0  <  <  1  and  0  <  <1  ,  the  parameter  ,  which 

is  equal  to  1  -  aj_  -  t>i  ,  must  then  obey  the  relation 
-1  <  o±  <  1  •  However,  this  restriction  is  not  strong  enough 
to  keep  Qi  p  *  a^  +  p  in  the  closed  interval  (o,i]  .  For 

instance,  if  a^  »  0  ,  and  *  -1  ,  then  p  *  -p  which 
is  impermissible.  This  shows  that  a^  and  are  not 
independent.  For  a  positive  p  *  p  is  a 

maximum  when  p  *  1  ,  i.e.  ajL+ai<l  or  a^<l  =  a^. 
Therefore  must  lie  in  the  shaded  area  of  the  following 
figure. 


Fig.  1.2  A  plot  showing  restrictions  on  the  parameters 
a^  and  bi  when  the  function  p  is 
restricted  to  have  positive  slope  .  The 
triangular  shaded  area  represents  the  admissible 
region.  (Reproduced  from  (l)  page  3U) 

When  is  negative,  p  ■  a^  +  Oj_  p  becomes  a  maximum  when 
p  »  0  and  so  a^  <1  *  Qi  P  *  ai  +  ®i  P  becomes  minimum  if  p  *  1  . 


- 
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i.e.  0  <  ai  + 

(1.1.23)  -*±  <  Oj. 


Thus  by  combining  the  above  inequalities  for  positive  and 
negative  a*s  ,  we  have 

(1.1.2k)  ^  <  ai  <  1  -  • 


This  range  of  possible  values  of  a^  and  is  shown  in 
the  following  figure. 


Fig.  1.3  Plot  showing  the  possible  values  of  cy.  and 
a±  .  The  shaded  area  indicates  the  values 
consistent  with  the  restrictions .  0<»i<l  , 

-a^  <  <  1  -a^  .  (Reproduced  from  (lj  page  35  ) 
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' 

.  "  .  '  '  ■i'  ■  ' ■■  '  '  :  '  ’•  • 
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For  the  fixed-point  form 

Qi  p  =  °Ci  p  +  (1  -  OjjXi  , 

it  follows  from  the  above  discussion  that  the  restriction  is 

(1.1.2$)  0  <  \i  <  1  . 

When  ct£  is  positive,  p  has  an  increasing  type 


of  character. 

For  example. 

let  OjL  = 

o.5  A.i  ®  1  p  *  0.2 

Then 

Qj1  p  =  0.10  +  0.5  »  0.60 

Q±2  p  -  0.30  +  0.5  3  0.8 

Q±3  p  -  o.Uo  +  0.5  -  0.90 

Q±k  p  -  0.U5  ♦  0.5  -  0.95  . 

However,  when 

a  is  negative,  p  has  an  oscillating  type 

of  character. 

For  example 

let  » 

-0.5  X^  *  ®  ^  P  ■  0.2  . 

Then 

p  =  -0.10  +  0.75  =  0.65 

Q±2  p  -  -0.325  +  0.75  «  O.U25 

Q±3  p  *  -0.213  +  0.75  -  0.538 

qX  p  =  -0.269  +  0.75  -  0.1*81  . 

Throughout  the  rest  of  this  thesis,  we  shall  restrict  ourselves  to 
0  <  OjL  •  Thus  the  restrictions  on  the  parameters  are  as  follows t 
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(a)  SLOPE-INTERCEPT  FORM: 

(1.1.26)  Qi  P  “  ai  +  <*i  P 

0  <  a^  <  1  0<ai<l"ai 

(b)  GAIN-LOSS  FORM: 

(1.1.27)  Qi  p  *  p  ♦  %  (1  -  p)  -  bjL  p 

0  <  <  1  0  <  b^  <  1  0  <  a±  +  b±  <  1 

(c)  FIXED-POINT  FORM: 

(1.1.28)  Qi  p  *  a±  p  +  (1  -  Oi)Ai 

0  <*±  <  1  0  <  «i  <  1  * 

Repetitive  Application  of  the  Operator  Tx 

As  shown  above, 

£l  *  I  ♦  (1  -  ai  )Kl  >  so 

Z±mI±  ’  Zi  “  (®i  1  +  (1  -  ai)Aij  *  (ai  X  +  (l  -  a± ) AjJ 

s  ai2  Z2  +  ai^l  -  A-i  +  ^(l  -  ai )A-i  Z 

+  (1  -  )2JJi| 


. 


' 


. 


r 


However, 


42  - 

1  \ii  ^  \ij 

Ms.  | 

• 

Xii  ?  Aij 

Ms  j  Ai  j 

• 

•  *  •  Ai!  2  Aij 

•••  AU  j  Xij 

•  •  •  • 

• 

V  Xir  j 

• 

Air  j  Ai3 

♦  •  •  • 

**•  MW 

/.Ai j-i  * 

Ai2  s 

Ai  > 

and  so 

h2  36  a±2  i  +  2a±(1  *  ai )  A*  +  (1  -  a±)2 A± 

*  ai2  I  +  C1  “ 

To  prove  that  in  general 
(1,1.29)  T±n  -  I  ♦  (1  -  c^11^  , 
assume  that  this  holds  for  the  nth  case 
i.e.  Tj”  -  a±n  I  +  (1  -  . 

Then  for  the  (n  ♦  l)th  case 

d.1.30)  Zin*1»Ii(Tin)  -  (“i  I  ♦  (1  -  °i)A^l  joi”  I  ♦  (1- 
-Oj”  1  I  ♦  (1  -  Ai  ♦  “i(l  -  jAj 

♦  (1  -  a±)  (1  -  a±n  )A±2 


V  ■"  > 


f 


-  17  - 


*  a.n+1  I  +  [(l  -  +  (l  -  o:in)ai  +  (1  -  a.)(i  -  a.n)]A. 

=  a.n+1  i  +  (l  -  a.11+i)  A  , 

x  —  X  —i 

which  is  of  the  same  form  as  in  the  nth  case.  Hence  in  general, 
(1.1.29)  is  true 


i.e.  T.n  =  a.n  i  +  (1  ~  a.n)  A.  . 

— 1  1  —  1  — 1 

Thus  by  (1.1.12)  ,  applying  T  n  on  £  ,  we  have 

(1.1.31)  Ij”  E  -  “i”  E  +  (1  -  • 

Since  |co|  <  1  ,  for  |  J  <1  , 


lim  T.n 
—l 

n  —>  oo 


£ 


lim 


a  ri  £  + 


n 


(1  -  a.n)X  =  X„ 

x  —1  —1 


Hence  for  |co|  <  1  ,  is  the  limiting  vector  of  the  application 

of  the  operator  T  on  the  vector  £  an  infinite  number  of  times. 
The  following  figure  shows  the  effect  of  successive  application  of 
the  operator  on  p  when  p  =0.1,  =  0.8  and  CO  =  0.9. 


Fig.  1.4  Values  of  Q^n  p  plotted  against  trial  number  n  . 

q/p  =  o^p  +  (1  -  «ia)Xi  with  p  =  0.1,  X  *  0.8, 
and  CO  -  0.9  were  used  in  plotting  the  curve. 
(Reproduced  from  [l]  page  60) 
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In  the  case  r  «  2  ,  £  “  ( 1  ^  p}  ”  ^qj 
(1.1.32)  ^£  =  1."  (?)  .  =  a.n£ 

a 


+  (l  -  a.n) 

1  '  —  X 


a. 

i 


■  (S) 


+  (1  -  a.n) 


n 

^2i 


i.e.  q/1  p  =  05  n  p  +  (l  -  Qi^nj\  ^ 


\n  q  =  a.11  q  +  (l  -  <**)X2i 


Thus 


(1.1.33)  lim  Q±n  p  =  lim  ^  p  +  (l  -  ain^Si 

n  —>  oo  n  — >  00 


X ..  .  for  I  CL. 

lx  l 


<  1 


(1.1.34)  lim  Q.n  q 

n  ->  oo 


lim  a.n  q  +  (l  ~  a.n)X0. 
i  n  x  2i 

n  — >  00 


=  X 


2i 


We  call  X  and  Xg^  the  limit  points  of  the  operator  T\ 


Concept  of  Symmetry  for  Two  Events 


Consider  a  case  of  two  responses  and  two  events  with 


operators 


and  Q2 


With  the  same  notation  as  before, 


Ql  P  -  ax  P  +  (1  -  a1)X1 


A 


% 


{. 


.  ■  l-  : 
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Q2  P  =  a2  P  ♦  (1  -  a2)X.2 
Let  (1.1.3$)  Q2  q  »  1  -  Q2  P 

=  1  -  a2  p  -  (1  -  a2)\2 

*  q>2  q  +  (i  -  a2)(i  -^*2)  » 

and  define  the  symmetry  requirement  as  follows s 

•x- 

Qi  P  *  Q2  P  and  Qx  q  s  Q2  q  . 

This  is  true  if  and  only  if 

(1.1.36)  a2  * 

(1.1.37)  1  -^2  “K  • 

The  first  condition  states  that  the  slope  parameters  are  equal. 
This  is  called  the  equal  a  condition.  The  second  condition 
requires  that  Q2  and  Q2  have  complementary  limit  points.  The 
equal  a-condition  implies  that  event  E2  and  event  E2  have 
"equal  but  opposite"  effects  on  behaviour.  Ex  has  the  same 
effect  on  response  A1  as  E2  has  on  response  A2  ,  For 
experimenter-controlled  events,  the  equal  a  condition  gives 
minor  simplification. 


Section  Two 

Experimenter-Controlled  Events 

Events  are  defined  to  be  experimenter-controlled  if 
the  events  occur  with  probabilities  fixed  by  the  experimenter. 
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The  case  of  two  experimenter-controlled  events  involves  two 
events  on  each  trial  of  the  experiment.  For  example,  if  in  an 
experiment,  there  is  only  one  response  and  if  the  reward  of 
that  response  is  taken  to  be  an  event  E^.  and  the  non-reward 
of  the  response  is  taken  to  be  event  and  if  the  proportions 
of  reward  and  non-reward  are  fixed  by  the  experimenter,  then  the 
experiment  is  two  experimenter-controlled  with  one  response. 

Brunswik  T-  Maze  Experiment 

An  example  is  the  Brunswik  T-  Maze  experiment  which 
deals  with  the  reward  training  of  rats.  Suppose  there  is  an 
elevated  T-Maze  with  boxes  at  the  two  ends  of  the  T  .  A 
hungry  rat  is  placed  at  the  base  of  the  T  and  is  permitted 
to  go  along  the  Maze  to  the  turning  point  where  it  can  go  either 
to  the  left  or  to  the  right.  On  each  trial,  some  food  is  either 
placed  in  the  box  at  the  left  or  in  the  box  at  the  right.  The 
following  assumptions  are  made  . 

(1)  A  right  turn  with  a  reward  and  a  left  turn  without 
a  reward  produce  the  same  effect  on  the  probability  p  of 
turning  right  on  the  next  trial  and  they  constitute  a  single 
event  Ex  with  operator  Qx  • 

(2)  A  right  turn  without  reward  and  a  left  turn  with 
reward  have  the  same  effect  on  p  ,  the  probability  of  turning 
right  on  the  next  trial,  and  they  constitute  another  single 
event  E2  with  operator  Q2  • 
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(3)  During  the  trials,  a  proportion  tti  of  the 
rewards  are  placed  on  the  right  side  and  a  proportion 
ir2  ■  1  -  nrx  of  the  rewards  are  placed  on  the  left. 

The  following  are  the  four  possible  response- 
outcome  pairs s  — 


Response 

Outcome 

Operator 

Prob.  of  Occurrence 

right  turn 

reward 

Qi 

p  n% 

left  turn 

non-reward 

q  it,  **  (1  -  p)tr, 

right  turn 

non-reward 

p(X  -  trg)  *  p  ir2 

left  turn 

reward 

q  «r8  -  (1  -  p)ff2  . 

From  the  above,  the  probability  of  the  event  Ex  is 
p  %  +  (l  -  p)w,  «  w  and  the  probability  of  the  event  E  is 
p  +  (l  -  p)w2  »  ir2  ,  with  +  it2  ®  1  .  Since  trx  and  w2 
are  fixed  by  the  experimenter  and  there  are  only  two  possible 
events  on  each  trial,  this  is  called  the  case  of  two  experimenter- 
controlled  events. 

Consider  the  effects  of  applying  operator  Qx  with 
fixed  probability  irx  and  operator  Q2  with  fixed  probability 
tt2  -  1  -  nx  in  the  case  of  two  experimenter-controlled  events 
with  responses  Ax  and  A2  #  Let  the  experiment  be  run  through 
by  a  large  number  of  initially  identical  animals  or  organisms 
for  n  trials.  Since  there  are  two  possible  events  for  each 
trial,  and  there  are  n  trials,  the  total  number  of  possible 
sequences  or  groups  j_s  2n  . 


'  xr  r  ? 


& 


:  ■ 


<  ■ 


' 


■■  ■'  -  ‘.i-  : 


■  _.f  •• 


v 

S  '•  f 


.  '  '  )  '  ■ 

„•  :  •  ’  '  '  :  '  .  f 


.  ■  ).  .  ■ 

-  j-ir 

- 

,  :  " 

:  '  •  i  :  ’ 

■  >  "  .  •. 


'  .  '•  V'"'  •'  .  !  '  ,  \  ' '  “j  ' 

-  '  i 


'  J  '  »  • 


‘  Y  .  >  : .  ■  if.  _  -  T 

1  ■  1  ’  . 

'  •  '  :-x ' 

.  '  ■  -  *fv  ’.*4  1 


! 


-  22  - 


Let  p^n  Le  the  probability  of  response  Ax  of 
the  vth  group  on  the  nth  trial  and  let  pyn  be  the 
proportion  of  the  population  in  the  yth  group.  Then  p  n  , 
the  average  probability  of  the  response  Ax  for  the  whole 
population  on  the  nth  trial  is 

2n 

(l.2,l)  pn  “  ^ 2^  P^Py^.  • 


On  the  (n  +l)th  trial,  the  new  values  of  p  would  be  as 
follows : 


New  Values  of 

JL 

New  Proportion 

Qi  Pya  E  ai  * 

ai  P^n 

*1  Pvn 

P>n  "  + 

“2  Pyn 

nz  ^yn 

and  so. 


(1.2.2) 


pn+i  *  2 
y®  1 


ni  ^ynW  +  S.  Vyn)  *  %  pyn^a2  *  a2  Pyn^ 


2  2 
2  n±  a±  *►  2  (tr±  cu)^ 


i=l 


i=l 


a  ♦  a  p 


n 


where  a  « 


2  ni  ai  "  ffi  ai  nz  a2  j  a 
i*l 


2  (ffj^  cc^)  «  xr^  ax  ♦  ir2  a2 


i=l 


Hence  from  the  above  a  new  operator  Q  is  introduced  such  that 


(1.2.3)  pn+1  -  $  ^  -  a  +  a  ^ 


M 


■  *  • 


“,-,V 

' 
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,  , 


a  i 


.  f 


'  ■ 


■ 

' 


'■  .  rr:  '■  •:  '■  <  ^  .  o 


^  -!  ~ 


Then  by  (1.1.31)  the  solution  of  the  difference  equation  is 


(1.2  .U)  pn  *  c?1  p  +  (1  -  a?1)  \  where  A.  -  - z 

1  -  a 


The  following  tree  diagram  shows  the  sequence  of  events  together 
with  their  probabilities  for  the  first  three  applications  of  the 


operators . 


Value  of  p 
Proportion  P 


Q1  P 


Fig.  1.^  The  successive  splits  that  a  large  group  of  animals 
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goes  through  after  three  events  when  the 
probability  of  applying  operator  Qi  is  tri  , 
given  an  operator  is  to  be  applied  (experi¬ 
menter-controlled  events).  The  proportions 
in  the  groups  written  beneath  the  p  value 
of  the  group  have  been  written  to  parallel 
the  Q ’s  rather  than  in  the  simplest  form  ~ 
thus  under  Q2  Qx  Q2  p  is  written  it2  tu  tr2 
rather  than  irx  n2^  •  (Reproduced  from  (l) 
page  70  ) 


It  is  clear  upon  examining  the  tree  diagram  that  if  Qx  has 
been  applied  u  times  and  Q2  has  been  applied  V  times, 
the  proportion  in  the  group  is  tfxu  itjf  • 


Moments 

Given  a  set  of  discrete  probabilities  Py  >  0  , 

V  *  1,  2,  ...  ,  finite  or  infinite  in  number  and  2  P^  *  1  , 
each  associated  with  a  number  ,  then  the  mth  raw  moment 
of  tie  distribution  of  p’s  is  defined  to  be 


(1.2.5)  Vm  =  2  p„"  P,  . 

In  words,  the  mth  raw  moment  is  the  mean  of  the  mth  power 
of  the  variable  whose  distribution  is  under  study. 

The  rath  moment  about  the  mean  is  defined  as 
d.2.6)  yUm  -  2  (pv  -  Vx)m  K  . 

That  is,  the  mth  moment  about  the  mean  is  the  average  of  the 
mth  power  of  the  deviation  of  the  variable  from  its  own  mean. 
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Moments  for  Two  Experimenter-Controlled  Events 


On  the  (n+l)th  trial,  the  mth  raw  moment  of  the 
two  experimenter-controlled  events  distribution  is  given  by  the  definition 
of  moments  to  be 


(1.2.7)  V, 


<  2n 


ra,n+i  "  ffi 


.  Z  (Qi  p„„)m  P* 

i»l  1^=1  ) 


2n  2n 
-  Wx  2  (a1  +  pyn)  P^n  +  vtz  2  (a2  +  a2  Pyn)m  ^yn 


“  %  2  u  a^11  pyn  Pvn  +  rtz  2  2(^)a2‘  u  a^1  py£  Pyn 

p  u  y  u 


nx  2(S)%m  11  °^.U  ^u,n  +  n2  2(^)a2m  u  ccg  Vu  n 
u  u 


Thus  the  mth  moment  of  the  distribution  on  the 
(n  ♦  l)th  trial  depends  on  all  the  moments  up  to  the  mth  on 
trial  n  • 


From  the  above  formula. 


(1.2.8)  \)I1+1  -  *x  \  *  ws  a2  +  ^  +  m,  ^)V1>n 

(l.2*9)  V2,n+x  *  ®x^  ^  ^2  ^  2(wj.  a^  ct^  +  tr2  a^  ®2^i,n 


+  (ffi  C^2  ♦  ir2  €fea)V2#n 


co  +  ci  vi,n  +  C2  V2,n 
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where 


C0  53  ttx  ax2  a22 


C1  ■  2K  ai  S  +  *2  a2  a2> 


C2  =  "l  V  *  "2  aS 


We  may  write  the  equation  (1.2.8)  in  the  form 


L  .  _  ®  a  +  a  V 
i,n+i  i,n 


where 


3  ™i  ai  +  "2  as 


and 


a  =  Wl  cdx  +  m2  a2 


This  is  a  single  linear  difference  equation  with  general  solution 


si  =-n 

¥  »  ^  . . .  +  K  a  ,  where  K  is  an  arbitrary 

1"  .U  " 


»n  1  -  a 


constant. 


Let 


V,  ■  lim  «  * 


a 


n— ><* 


1  -  a 


Then 


—  n 


V  a  V,  +  K  a  , 
i,n  i,co 


and  since 


V 


1,0  1,«» 


V,  +  K  , 


we  obtain 


K  *  V,  -  V 

1,0  l,co 


v— n 


Finally 

(1.2.10)  V1>n  -  V1>c.  -  (7„r  -  Vl>oy, 

Substituting  the  value  of  Vx  n  into  the  formula  for  V. 


,n+i  > 
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_n 


(1.2.11)  V2>nfl  -  (C0  *  cx  vx  J  -  cx(vx>„„  -  Vlj0)3  +  c2  v2>n 


C0'  *  V  «n  +  c2  v2>n 


where 


C  5  =  (V  +  C  V 
o  o  i  i,<® 


Cl'  ■  -“l*7!,.  -  V> 
By  definition,  V2j0  -  Vx^0  =  p02 


where  pQ  *  initial  probability  of  making  response  A1  ,  and  so 


V  sCJ  +  C?  +  C  n2 

2,1  O  1  2  F© 


V,  2  -  <V  +  C»  I  +  C2(C  »  +  G  »  +  C  p  2) 

^  f  v  *•  w  1  2  0 


c0'(i  ♦  C2)  +  cx'(c2  *  3)  +  c22  p0! 


and 


72,3  *  °0'  +  V  “2+  C2  7a,z 


C  9  +  C  '  c  +  c 
0  1  2 


C  '(1  +  C2)  *  CX'(C2  *  a)  *  C22  Po= 


C  >(1  +  c2  +  c22)  ♦  Cx'(32  *  C  a*  C  2)  +■  C2  p02  . 


This  is  of  the  form 

n-1  n-1 

(1.2.12)  V2>n  -  0o'  Z  C2U  +  C1 '  Z  3n"1-u  Cau  +  C2n  pQ2  . 

U=Q  U=0 


Assume  that  the  above  formula  holds  for  the  nth  case  and  consider 
the  (n  +  l)th  cases 


(1.2.13)  V2>n+1  -  <y  ♦  Cx'  in+  c2  v2>n 
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C  »  +  C  »  an  *■  C 
01  2 


n-i  n-i 

C  i  t  Q  u  +  c  »  jj  q q  u  ^  c  nt)2 

O  2  1  *  2  2  P0 

^  u=*o  u»o 


c  • 

o 


n-i 

n-i 

1  +  C  2  C  u 

o  p 

♦  V 

ln  +  2  a>MC  u+* 

„  u*o  ; 

v  11“0 

♦ca  W 


n  n 

C„'  2  C2U  +  Cx<  2  S"-u  Czu  *  C2nfl p02  . 

U*0  U®0 


This  is  of  the  same  form  as  in  the  nth  case  and  so  in  general 


(1.2 .111)  v2>n  -  C0'  V  C2U  +  Cj 1  V  3n-1-u  C2U  +  C2n  p02 

us© 


n-i 

2 

u~o 


c  »(i  -  c2n)  C  'C?1  -  c2n) 

- —  ♦  - - — *  c2n  Po2 


1-0, 


a  -  C. 


"•  *  °» ,'»>JrfS  »•>  St?  *  c‘*‘ 


Thus  for  |  aj J  <  1  and  | a^|  <  J  0  <  TTf  <  1  , 


(1.2.15)  lim  Vn  *  v2,»  " 

n-t>-  1  -  C2 


and  the  variance 


(1.2.16)  <*  -  V2^  -  Vlf 


1  *  Co  *  Cl  -  V  2 
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An  important  theorem  on  the  p-value  distribution  is 
given  by  Karlin  (2].  It  is  stated  here  without  proof.  For  two 
response  classes  and  experimenter-controlled  events,  an  asymptotic 
distribution  exists,  that  is,  the  p-value  distributions  on  trials 
n  and  n  +  1  may  be  made  as  close  to  one  another  as  one  wishes 
by  making  n  sufficiently  large.  Furthermore,  this  asymptotic 
distribution  is  independent  of  the  initial  distribution  of  p-values. 

Section  Three 
Subject-Controlled  Events 

If  the  occurrence  of  a  response  is  taken  as  an  event, 
then  events  of  this  type  are  called  subject-controlled  events. 

For  example,  for  two  alternative  responses  Ax  and  A2  ,  the 
experiment  is  subject-controlled  if  event  Ex  occurs  whenever 
the  response  Ax  occurs  and  event  occurs  whenever  the 
response  Ag  occurs.  In  the  Brunswik  T-Maze  experiment,  let 
it  be  so  arranged  that  if  the  rat  turns  right,  reward  is  always 
found  and  if  the  rat  turns  left,  reward  is  never  found.  Then 
this  simple  T-Maze  experiment  is  a  subject-controlled  experiment 
if  the  response  Ax  of  the  rat  to  turn  right  is  taken  as  event 
Ex  and  the  response  A2  of  the  rat  to  turn  left  is  taken  as 
event  E2  .  In  the  two  experimenter-controlled  event  case,  the 
response  is  determined  by  the  animal,  while  the  outcome  (i.e. 
reward  or  non-reward)  is  determined  by  the  experimenter. 
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However,  in  the  case  of  the  subject-controlled  events,  the 
outcome  is  completely  determined  by  the  response.  So  in  the 
case  of  two  subject-controlled  events,  event  E  occurs  when¬ 
ever  response  Ax  occurs  and  event  E2  occurs  whenever 
response  A2  occurs . 

Under  the  above  definition  of  subject  controlled- 
events,  the  probability  of  the  occurrence  of  event  Ex  on 
trial  n  is  not  a  constant  as  in  the  case  of  experimenter- 
controlled  events,  but  is  equal  to  the  probability  Pjj  of 
response  Ax  .  If  we  let  the  possible  values  of  the  response 
probability  p  be  the  states  of  the  system,  the  process  is  a 
Markov  process  since  the  conditional  probabilities  of  all 
other  states,  given  state  p  ,  are  independent  of  the  way 
in  which  the  state  p  was  achieved  i.e.  since  if  pn  is 
the  probability  of  Ax  on  trial  n  the  possible  values  of 
^n+x  depend  only  on  p^  and  not  on  pQ,  ...,  pn_a  . 

Since  the  probability  of  applying  Qx  to  pn  isr  pn 
and  the  probability  of  applying  Q2  to  pn  is  1  -  pn  , 
a  branching  process  similar  to  the  case  of  two  experimenter- 
controlled  events  is  obtained  and  is  shown  by  figure  1.6. 
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Value  of  p 
Proportion  P 


P 

1 


Q1  P 

p  Qx  p  Qx  p 


Q2Q1  p 
p  Qj  pd-Qj2  p) 


Q1  Q2  Q1  p 

pCl-Qi  p)Q2  Q1  p 

Q22  Qi  p 

pCl-Q-j^  p)(l-Q2  Qj  p) 

Ql2  Q2  p 

q  Q2  P  Q1  Q2  P 

Q 2  Q2  P 

q  Q2  p(l  “Q1  Q2  p) 

«22  P 

O 

q(l-  Q2  p)Q2  P 
Q23  p 

q(l-Q2  p)(l-Q22  p) 


Fig.  1.6  This  diagram  shows  the  successive  splits  that  a  large 

number  of  organisms  would  go  through  on  successive  appli¬ 
cations  of  the  operators  for  the  case  of  subject-controlled 
events.  Both  the  p  value  of  the  group  and  the  propor¬ 
tional  size  of  the  group  are  given  at  each  stage  of  the 
operation.  The  probability  of  applying  is  equal  to 
the  p  value  of  the  group.  (Reproduced  from  (l)  page  79) 
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Defining  Pn  as  in  the  case  of  experimenter- 
controUed  events  as  the  average  probability  of  the  occurrence 
of  event  Ex  on  the  (n  +l)th  trial,  the  values  of  p0  and 
Pa.  are 

(1.3.1)  PQ  *  P  , 

p2  =  p  Qx  p  +  q  Q2  p 

-  a1p2  +  a2q4.a2pq 

respectively.  Putting  q  *  1  -  p  , 

(1.3.2)  ^  *  a2  +  (a1  -  a2  +  a2)p  «►  (c^  -  a2)p2  , 

which  is  not  linear  in  p  and  so  is  not  in  the  form  in  which 
the  mathematics  of  section  one  of  this  chapter  can  be  used* 
However,  if  «*  Og  ,  the  p2  term  disappears  and  the 
expression  in  p  is  linear.  This  case  will  be  left  to  a 
later  discussion. 

It  is  obvious  from  figure  1.6,  that  pn  involves 
higher  powers  of  p  as  n  increases  and  this  fact  complicates 
the  mathematics  involved  and  the  methods  described  in  section 
one  of  this  chapter  cannot  be  used* 

Moments  for  Two  Subject-Controlled  Events 


Let  p^n  be  the  p-value  for  the  yth  group  of 
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organisms  after  n  applications  of  the  operators,  and  let 
be  the  proportion  of  the  v  th  group  in  the  whole 
population.  Upon  a  further  application  of  the  operators, 
the  following  is  obtained 2 


New  p-Value  New  Proportion 


Q 

p  »  a  ♦ 

a  p 

P  P 
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*vn  1 

1  ^yn 

*Vn  vn 

Q 

p  *  a  + 

a  P 

P 

1 

tj 

►0 

; 

• 

2 

Vn  2 

2  *Vn 

vn  vn 

Thus  by  the  definition  of  moments, 

2n  2n 
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Thus  for  the  mean  on  trial  n  +  1 


(1.3.W  V1>nfl  - 

clo  +  ^ii  vi,n  +  ci2  v2,n 
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and  for  the  second  raw  moment. 
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It  can  be  seen  from  the  recurrence  relation  (1.3.3) 
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the  nth  trial  and  this  makes  the  higher  moments  awkward  to 
evaluate . 


Equal  a-Condition 


(1.3.1*) 


Consider  the  case  »  az  =  a  .  Then  the  formula 


vn  +  C  V  +  C,0  V  „  with 

i,n+i  io  ii  i,n  12  2,n 


cio  "  a2  j  **  ai  ”  a2  +  a2  »  and  C12  *  %  -  as 


becomes 


(1,3.5^  ri  ,n+i  “  a2  +  (ai  ”  a2  +  a2 ) ,n  +  (®i  ”  a2 )'^2 ,n 

=  a„  +  (a.  -  a„  +  a)V,  , 

2  v  i  2  7  i,n  9 

which  is  of  the  same  form  as  the  slope  intercept  form.  This 
suggests  the  introduction  of  the  operator  Q  such  that 


(1.3.6)  Vljn+1  -  Q  V1>n  -  a2  *  (ax  .  aa  *  a)V1>n 


a2  *  0  vi,n  9 
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Thus,  by  comparing  with  the  slope  intercept  form. 
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and  so  the  asymptotic  formula  for  the  mean  is 


(1.3.7)  Vj 


X: 


1  —  {3  1  -  ax  +  a2  —  a  1  —  +  X; 


Furthermore,  the  explicit  formula  for  the  means  can  be  obtained  as 


(1.3.8)  vl>n  -  Q°  V1>0  -  f  7lj0  +  (1  .  . 


An  interesting  property  of  the  mean  of  the  two  subject-controlled 
events  distribution  is  that  it  can  be  expressed  independently  of 
the  value  of  a  . 

Putting  vi,n+i  s  a2  *  (ax  -  a2  +  a)Vljn  in  the  gain-loss  form 

of  Qx  by  introducing  the  parameter  bx  *  1  -  aT  -  a  as  defined 
in  section  one, 

(1,3*9)  T^i ,n+i  3  a2  +  (l  -  a2  -  bx )VX • 

Thus  for  the  case  where  the  a’s  are  equal,  the  means  are 
independent  of  the  value  of  a  , 

The  recurrence  formula  for  th^  moments  is 
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where 

2  2 

B,  »  a  -  a  +  2a  a 

1  1  2  2 

B2  =  a^a-L  -  2a2  +  a)  . 

Since 

?i,n  -  ?i,«,  -  (vs„  -  vlj0)pn  , 

(1.3.12) 

,n+i  -  ?i  J  -  -  ?1?0)pn  *  B2  V2>n 

which  is  a  difference  equation  of  the  same  form  as  (1,2.13)  in 
the  case  of  two  experimenter-controlled  events,  and  so,  applying 
the  same  method  of  solution. 


(1.3.13) 

V2,n  *  (V  +  B!  T!,j  -  B^VX,-  -  'l,0> 

9  1  »  B2  0  -  B2 

♦  ¥  , 

2  2 ,0  ? 

where  0  and  Q  are  the  initial  mean  and  second  raw 
moments  respectively.  If  -1  <  B2  <  1  ,  -1  <  0  <  1  ,  and 

0  /  B2  ,  in  the  limit  as  n  — >  ®  ,  the  asymptotic  formula  for 
the  second  moment  is 


(1.3.1b) 

a22  +  B]_ 

V2,»  "  ~ ^ 

1  -  Ba 

where  Vlj0o  is  the  asymptotic  formula  for  the  mean.  Thus  the 
variance  of  the  two  subject-controlled  events  distribution  in  the 
equal  a  case  is 
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(1.3.15) 


Asymptotic  Distribution  Theorem. 

Harris  has  shown  in  (3)  that  the  same  asymptotic 
distribution  theorem  for  two  response  classes  and  experimenter- 
controlled  events  stated  at  the  end  of  section  two  of  this 
chapter  holds  for  two  subject-controlled  events  if  the  a^'s  are 
non-negative  and  the  absolute  value  of  the  difference  between 
the  two  limit  points  is  less  than  unity*  When  the  limits  are 
zero  and  unity,  these  special  cases  are  discussed  in  (_l)  chapter 
seven.  For  the  case  ^  s  1  »  and  7\z  38  0  ,  it  is  shown  that 
the  asymptotic  distribution  depends  on  the  initial  probability 
pQ  except  when  a  *  a2  *  1  .  For  the  case  ^  »  0  and  \g  »  1  , 
it  is  shown  that  the  asymptotic  distribution  is  independent  of  the 
initial  probability# 
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CHAPTER  II 

MOMENT  GENERATING  FUNCTIONAL  EQUATIONS 
ASSOCIATED  WITH  TWO  EXPERIMENTER-CONTROLLED  EVENTS 
AND  OF  WO  SUBJECT-CONTROLLED  EVENTS 

In  this  chapter,  the  moment  generating  functional 
equations  of  the  distributions  of  p-values  for  two  experimenter- 
controlled  events  and  two  subject-controlled  events  will  be 
derived.  In  section  one  we  review  the  techniques  used  by 
R.  R.  Bush  and  F.  Mosteller  for  studying  the  asymptotic  dis¬ 
tributions  of  p-values.  Section  two  of  this  chapter  deals 
with  the  experimenter-controlled  events,  and  section  three  deals; 
with  the  subject-controlled  events. 

Section  One 

An  approximation  to  the  asymptotic  distribution  can 
be  obtained  by  the  "Stat-Rat"  or  "Monte  Carlo"  method  when  the 
constants  of  the  operators  are  given.  A  stat-rat,  in  fact,  is 
a  "hypothetical  animal"  which  obeys  the  given  mathematical  model. 
The  method  makes  use  of  random  numbers  and  we  illustrate  it  by 
the  following  example. 

Let  the  experiment  be  subject-controlled  with  the 
mathematical  model  pc  *  0.2,  a^^  »  0.3,  ■  0.6,  a 2  «  0.01, 

as  -  0.9  i.e.  Qx  p  »  0.6p  ♦  0.3  and  Q2  p  -  0.9p  +  0 .01  . 
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Table  2.1  gives  the  mechanism  of  the  method.  Column  one  gives 
the  trial  number;  the  second  column  gives  the  p~  values  for 
each  trial  and  the  third  column  is  a  set  of  2-digit  numbers  from 
a  random  numbers  table  and  the  fourth  column  gives  the  operator 
to  be  applied  on  each  trial.  The  random  numbers  of  column  three 
are  of  the  form  00,  01,  ...,  99*  The  number  00  stands  for  all 
decimal  numbers  from  0.00000...  to  0.00999* ••  respectively* 
Operator  Qx  is  applied  whenever  the  random  numbers  stand  for 
values  less  than  the  corresponding  p-value  on  the  nth  trial. 
Operator  Q2  is  applied  otherwise.  For  example,  if  the 
probability  of  applying  Qx  is  0.3UU  on  a  certain  trial,  then 
if  the  random  number  taken  is  less  than  3k  i.e.  00,  01,  ...,  33  , 
operator  Qx  is  applied.  If  the  random  number  is  greater  than  3k } 
i.e.  35,  36,  ...  99,  operator  Q2  is  then  applied.  If  the  random 
number  3k  is  obtained  which  is  equal  to  the  first  2  digits  of  the 
probability  0 .3UU,  the  ambiguity  is  solved  by  adding  additional 
digits  to  the  end  of  the  number  until  a  decision  is  reached.  The 
above  procedure  is  clarified  if  we  folic*?  a  few  steps  in  table  2.1. 
The  initial  p  — value  was  0.2  and  the  first  random  number  taken 
was  8k  which  is  greater  than  20  and  so  Q2  was  applied  to  the 
initial  p  (0.2)  to  give  the  new  p  value  0.1900.  The  next 
random  number  taken  was  29  which  was  greater  than  19  and  so 
Q2  was  applied  again.  This  procedure  was  carried  on  until  on  the 
6th  trial,  the  random  number  05  which  is  less  than  15  was  chosen. 
So  Qi  was  applied  to  0.1531  giving  a  new  p- value  of  0.3919* 


•  r-  •  - 


r> 


‘O  '  *  ,r 


r 
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TABLE  2.1 

Illustration  of  a  computation  sheet  for  25  trials  of  one  stat- 
rat.  The  operations  are  Q],p  «  0.3  +  0.6p  and  Q2p  *  0.01  +  0.9p 
and  p0  *  0.2,  (Reproduced  from  (l)  page  130 ) 


Trial 

Number 

p- value 

Random 

Number 

Operator 

0 

0.2000 

81* 

q2 

1 

0.1900 

29 

q2 

2 

0.1810 

35 

q2 

3 

0.1729 

69 

q2 

k 

0.1656 

53 

q2 

5 

0,1590 

37 

q2 

6 

0.1531 

05 

Qi 

7 

0.3919 

50 

q2 

8 

0.362? 

57 

q2 

9 

0,336k 

60 

q2 

10 

0.3128 

55 

q2 

11 

0.2915 

58 

Q2 

12 

0.2?2U 

79 

q2 

13 

0.2552 

50 

q2 

lit 

0.2397 

56 

q2 

0.2257 

01 

Qi 

16 

O.U35U 

51 

Q  2 

17 

0.1*019 

65 

q2 

18 

0.3717 

92 

Qi 

19 

0.3UU5 

32 

Qi 

20 

0.5067 

21 

q2 

21 

0.60U0 

66 

Qi 

22 

0.5536 

35 

Qi 

23 

0.6322 

18 

Qi 

2h 

0.6793 

65 

Qi 

25 

0.7076 

_ 


' 


" 
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Although  table  2.1  glares  the  run  of  a  stat-rat  of  2£  trials, 
the  number  of  trials  can  be  carried  as  far  as  one  wishes.  When 
the  number  of  trials  is  sufficiently  large,  the  final  p-value 
can  be  taken  as  an  approximation  to  the  asymptotic  p-value . 

The  initial  p-value  can  be  taken  arbitrarily  since  the  asymptotic 
p-values  are,  except  in  certain  special  cases  stated  at  the  end 
of  section  three,  chapter  one,  independent  of  the  initial  p-value. 
Thus  by  taking  a  large  number  of  stat-rats,  an  approximation  of 
the  asymptotic  distribution  can  be  obtained.  Naturally,  we  would 
like  to  approximate  the  asymptotic  distribution  with  a  specified 
accuracy.  Suppose  that  we  want  to  have  a  class  interval  i  in 
computing  the  approximate  distribution.  As  p0  is  arbitrary, 
the  question  arises  how  many  trials  are  necessary  in  order  that 
pn  and  pn '  arising  from  p0  and  p0f  lie  within  the  same 
class  interval.  That  is,  we  want  to  find  an  n  such  that 

(2.1.1)  Pn-V  <  V 

For  the  experimenter-controlled  events, 

Qi  Po  -  Qi  P0’  *  ai(Po  -  Pc'5  • 

Let  p  be  the  largest  (i  =  1,  ...  t)  ,  4 net  P0  >  P0*  .  Then 


) 


Qi  Po  -  Po’  £  P(Po-Po') 


, 


Ji;  •  : 
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Pi  -  Pi'  <  P(p0  -  p0') 
p2  -  P2’  <  P2(p0  *  Po')  • 

Thus  by  induction,  in  general 
(2.1.3)  Pn  -  Pn'  <  Pn<P0  -  Pc')  * 

It  can  be  shown  (see  "Trapping  Theorem"  [l]  page  99)  that  the 
asymptotic  p -values  lie  between  \Tn^ri  and  A.max  Thus  choosing 
p0  and  p0’  to  lie  between  these  limits  it  follows  that  Po  -  Po’ 
is  less  than  or  equal  to  ~Xmin  ^  >  311(1  50  we  W0UTd  require 

n  to  satisfy 

(2.1,10  p  ^max.  ”^min.^  —  ^ 

Thus  if  %  =  0.6,  a2  *  0.9  ,  Ax  *  0.75  9  X2  ®  0.1,  then 

6:  =  0.9  *  *  0.75  and  \  .  is  0.1.  If  the  class 

max •  min • 

interval  Y  «  0.01  the  inequality  is 

(2.1.5)  (0.9)n  (0.75  -  0.10)  <  0.01 

or  (0.9)10  <  0.015U  . 

The  smallest  n  which  satisfies  this  inequality  is  n  *  UO  .  Thus 

U0  stat-rat  trials  would  make  certain  that  even  the  extreme  values 

of  pQ  lead  to  final  p-values  in  the  same  of  adjacent  classes  in 

the  desired  distribution.  However,  in  ordinary  cases,  a  smaller 

number  is  required  as  it  is  rare  to  use  X„,ov  and  X  .  values  as  p0  . 

max .  min •  u 


i.e. 

and 


- 

. 
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TABLE  2.2 

Frequencies  of  p  values  which  occurred  in  a  1000  trial 
stat-rat  with  Qxp  *  0.3  ♦  0.6p,  Q2p  -  0.01  ♦  Q.9p,  irx  *  tr2  ■  0.5. 
All  p  values  were  rounded  to  two  decimals,  (Reproduced  from 
(l)  page  13U) 


p 

f 

P 

f 

P 

f 

<  0.26 

0 

0.1*3 

6 

0.60 

33 

0.27 

1 

0.1*1* 

0.61 

53 

0.28 

0 

o.l*5 

7 

0.62 

58 

0.29 

1 

0.1*6 

7 

0.63 

23 

0.30 

0 

0.1*7 

13 

0.61* 

58 

0.31 

1 

0.1*8 

10 

0.65 

1*1* 

0.32 

1 

0.1*9 

11 

0.66 

36 

0.33 

1 

0.^0 

8 

0.67 

65 

0.3U 

1 

0.51 

28 

0.68 

57 

0.35 

0 

0.52 

17 

0.69 

28 

0.36 

1 

0.53 

20 

0.70 

55 

0.37 

2 

o.5U 

28 

0.71 

1*1* 

0.38 

2 

o.55 

18 

0.72 

30 

0.39 

6 

0.56 

32 

0.73 

32 

o.Uo 

3 

0.57 

36 

0.7U 

1*6 

o.Ui 

3 

0.58 

22 

0.75 

_ 0 

0.1*2 

9 

0.59 

38 

1000 

■ 


) 


t 


i'% 

i 
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For  two  subject-controlled  events,  it  is  difficult 
to  obtain  a  good  estimate  of  this  kind* 

The  above  method,  however,  is  very  wasteful  because 
only  the  final  p-value  of  a  stat-rat  is  used  for  the  appro¬ 
ximation  of  the  asymptotic  distribution.  It  can  be  shown  (see 
"Ergodic  Theorem"  (l)  page  99)  that  a  single  stat-rat  can  generate 
the  asymptotic  distribution  provided  the  sequence  becomes  infinitely 
long.  Thus  as  an  approximation,  if  the  total  number  of  trials  is 
large  compared  with  the  number  necessary  for  a  single  final  value, 
the  stat-rat  can  be  used  to  approximate  the  asymptotic  distribu¬ 
tion.  For  example,  in  the  previous  numerical  case,  instead  of 
UO  trials,  a  single  stat-rat  of  say  1000  trials  would  be  quite 
adequate  and  the  method  of  the  approximation  is  illustrated  by 
table  2.2. 


By  the  stat-rat  method,  R.  R.  Bush  and  F.  M^teller 
in  (l]  obtain  a  number  of  approximate  asymptotic  distributions, 
but  the  only  exact  asymptotic  distribution  which  they  have  obtained 
is  the  case  of  two  subject-controlled  events  with  a  ®  fflg  -  © 
and  A.  “1,  A.  “  0  .  It  is  a  simple  binomial  distribution 
with  all  density  concentrated  at  p  »  0  and  at  p  =  1  • 


,  f 

'  ■-  • 

’  '  • 

:  :  "  ;■  -•  r.  v;>  \  >  :  .  \  '  r>  v  -  — •  ■ . ! ' 

.  ■  .  .... 

' 

r:  '  ’  "  .■  '  ’  '  : 
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v  ■ 
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Section  TVo 

We  define  a  moment  generating  functional  equation  as 
follows.  Let  x  be  a  random  variable  and  let  M^Xt)  be  the 
moment  generating  function  of  the  probability  distribution  of 
x  .  Then  a  moment  generating  functional  equation  is  a  functional 
equation  satisfied  by  Mx(t )  .  For  example,  if  x  is  a  binomial 
random  variable  taking  values  -1  and  +1  with  probabilities 

1  and  1  respectively,  then 

2  ft 

(2.2.1)  ^(t)  *  cosh  (t)  ,  and  since 

(2.2.2)  cosh  2t  “  2  cosh2  t  -  1  , 

a  moment  generating  functional  equation  satisfied  by  M  (t)  is 

dtL 

(2.2.3)  Mx(2t)  =  2  cosh  t  M^t)  -  1  . 

In  chapter  one,  it  was  shown  that  on  the  nth  trial 
of  a  two  experimenter-controlled  events  experiment,  there  are  2n 
possible  probabilities  p^n  (called  p-values)  (  ®  1  ,  ...  2n) 

of  making  response  Ax  each  with  proportion  P^n  •  Thus  the 
moment  generating  function  of  the  distribution  of  p-values  on 
the  nth  trial  is 

2n 

(2.2.U)  Mn(t)  -  Z  etPvn  Pvn  . 


' 


■  r  -• 

, 

. 

■ 

:  • 

• 

' 

■ 

- 

- 

. 

. 

. 

•  ■  .  '  . 

,  '  "  .'V' v  I  > L  .:r‘  :nr,~ 

■  •  ■  "  • ' 


n  ■ 


... 

*  •  ■ 


, 


Since  each  p  on  trial  "n”  generates  two  new  values  a,  +  0!,  p 

j/n  °  11  ri^n 

with  probability  P^  and  p^  with  probability 

Jtg  P^n  ,  on  trial  "n  +  1'*,  it  follows  that 


(2.2.5) 


M  _(t) 
n+1  ' 


2“ 

Z  (e 

JJ  Btl 


t(a  +a  p  ) 
1  1  vn 


tc  ,  P  +  e 
1  yn 


Jt0  P  ) 

2  t/n 


ta  2n 
=  jt1  e  1  2 


(taL)P 


^n 


ta^ 


P  +  nn  e 
yn  2 


n 


<ta2)EVn 

2  e  ^  P 


2 

2 

i/=l 


=  5t 


1 


tai  taP 

e  M  (a  t)  +  n  e  M  (a  t) 
n  1  2  n  2 


y 


and  so  as  n  approaches  infinity,  we  obtain  the  asymptotic  functional 
equation 


ta1  ta? 

(2.2.6)  M(t)  *  rt1  e  M(ait)  +  itg  e  M(agt) 


where  M(t)  =  M^t)  ,  M^t)  s  M^^t)  and  Mf^t)  =  M^O^t) 


In  the  case  a^  =  =  oi 


ta,  ta^ 


(2.2.7)  Mn+1(t)  -  Mn(ot)  [«!  e  1  +  ifg  e  ^3  , 


and 


ta,  ta^ 


(2.2.8)  M(t)  *  M(at)  U1  e  1  +  jtg  e  2] 


e 


'  0  1  : '  ■'  .  Oi ... 


-r 


'/V  ;.i 

,  -  . 


)c  '  ■  o  "  nj.: 


It  -r 


/  - 

3t  ^ 


_  1  : 
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Section  Three 

From  chapter  one,  on  the  "n"  th  trial  of  the  two  Subject- 
controlled  events  experiment,  there  are  2n  possible  p-values 
Pyn  (where  y  ■  1,  . ..  2n)  of  making  response  Ax  each  with 
proportion  P  respectively.  Thus  the  moment  generating 
function  of  the  distribution  of  p-values  on  the  "n"  th  trial  is 

2n 

(2.3.1)  M  (t)  -  2  etlVn  P  . 

n  y.i  "n 

Since  each  p  on  trial  "n"  generates  two  new  values 

ai  +  ai  p]/n  with  Probability  Pvn  *Vn  » 


and  ag  +  %  Vyn  with  probability  (l  -  P^n)^n  , 


on  trial  "n  +  1"  it  follows  that 


(2.3.2)  VW  -  *  •t(‘1+aiP^)  P,„  P„  * 

j/sl 


gn  2n 


tai  _  tctip^n  p  .  t  _tu2p^n  p 

e  i  e  pyn  e  l  e  r 

j/«i  j/=i 


2n 

-.**»  2  p  p 

^i/n  j^n 

y®i 


rs^-owvT  , 

'  f  :  :•  •  ■  '  -  :  • .  • 

.  1  '  ■  ■. 

■ 


! 


'  ' 


' 


r.' 


' 
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.n 


-  •**  *  eta2pvn  P  +  ^  r„n 

2/»  i  j/«i 


L.  2  etai3Pvn  P 
02  dtj,.x  vn 


+JS  fitaj  ta2  , 

e  2  Mn(ast)  *  —  ^.(ait)  -  —  ^  M^t) 


ct2  dt 


where  %  ,  ol,  /  0  •  For  the  equal  a  case. 


(2.3.3)  Vi(t)  “  et32  "nf**)  +  "  —  tt  “n^) 


a 


dt 


Letting  n  approach  infinity,  the  asymptotic  moment-generating 
functional  equation  is 


(2.3.U)  Hm  Vi(t)  -H»(t)  -  etaa  M.(a2t)  ♦  55:  Mojt)  . 


e^i  d 


n— c*» 


_ta2 
e  d 

02  dt 


M«(a,t) 


or  M(t)  *  e^2  M(a2t)  *  ~~  —  M^t)  -  2-Jl  i-  M(a2t) 

ai  dt  as  dt  ' 


where  M(t)  *  M»(t)  ,  M(axt)  ■  Moo^t)  and  M(a2t)  s  ^(Ogt)  • 


For  the  equal  a  case,  the  asymptotic  moment  generating  functional 
equation  is 


(2.3.5) 


M(t)  ■  e^cl  M(at)  +  e^1-  e^a2  d_  M(at)  # 

a  dt 

We  define  the  characteristic  function  of  an  asymptotic  distribution 
to  be 

2 

(2*3*6)  0(t)  *  M(it)  ,  where  i  =  -1  . 


Then  from  (2  *3*U)  the  characteristic  function  6f  the  asymptotic 
distribution  of  the  two  subject  «  controlled  events  model 
satisties  the  functional  equation 

(2.3.7)  0M  -  e1^  ^(ajt)  -  leltol  d_  0Kt) 

<h  dt 


In  the  equal  a  case,  (2. 3 #7)  becomes 

(2.3*8)  0(t)  -  eita2  0(oct)  «  j(eitai  -  eltag) 


and  if  a®  1  we  have 


ita*'  0(t/2)  -  21  (  eltai  -  eit3z)  d_  l«t/2)  . 

dt 


+  ieitaz  d^  0(a2t) 
a2  dt 


d|  0(at) 
dt 


(2.3.9) 


0(t)  «  e 


r 


* 


<  * 


*  4 
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CHAPTER  III 

SOLUTION  OF  SOME  SPECIAL  CASES  OF  THE 
ASYMPTOTIC  MOMENT  GENERATING  FUNCTIONAL  EQUATIONS 

In  this  chapter,  some  special  cases  of  the  moment 
generating  functional  equations  under  the  equal  a  condition 
derived  in  chapter  two  will  be  solved  and  their  properties  will 
be  discussed*  The  first  section  deals  with  two  experimenter- 
controlled  events  and  the  second  section  deals  with  two  subject' 
controlled  events. 


Section  One 


Fran  chapter  two,  equation  (2.2.7),  the  moment  generating 
function  of  the  two  experimenter-controlled  events  model  in  the 
equal  a  case  satisfies 


Vi(t)  ■  Vat) 


tan  .  tag 

ir  e  1  +  t?2  e  3 


Since  Ml(t)  =  et(8i+ap)  +  n  et(a2+ 


<rp) 


apt 

e 


(%  s**1  *  ■, 


9 


where  p  =  initial  probability  of  making  response  Ax 
Mg(t)  •  Mj. (at)  (tr x  et&1  +  w2  et&2) 


9 


. 


. 

t  U  '  ,  "  '■  ""  '  1  '"i  r'.'  O  :  T"'  J:  t-:n 


' 


*  - 

:  ■ 


■ 


-  ■  • 


' 


.  .  '  : 


’  ‘  i  '  35  ' '  •  ■ 
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a2pt  -rr  t  ta^a-  t<rWs 

e  II  (n-,e  1  +  tr,e  z) 

j»o 


Mj(t)  *  M2(at)(n1  e^1  +  rr2  e^&2) 


a3pt  /  ta.a^  ta2a^N 

e  r  IT  (Trx  e  1  +  w2  e  2  )  , 

5“o 


the  asymptotic  moment  generating  function  is  equal  to 

(3.1.1)  M(t)  -  lira  eaPvt  II  (nx  e*®1®3  ♦  tr2  e*®2®*5) 

j-o 

*  /  ta,  taPo^v  „ 

*  II  (w,  ©  1  +  w_  ©  2  )  for  0  <  a  <  1 

3=o 

To  see  if  M(t)  for  0  <  a  <  1  is  convergent  or  not,  assume 


and 


(a) 

0  <  >  vs 

<  1 

and  1%  +  w2 

(b) 

0  <  ax  >  a2 

<  1 

and  ax  >  a2 

(c) 

0  <  a  <  1 

) 

(d) 

t  is  real 

• 

Then 


(3.1.2)  [log  M(t)|-|  2  log  (wx  etai®  ♦  wz  e*®2®  ) 
'  I  j-o 


' 


'  ,V.  ' 


- 


I  r'.: 


1 


’ 


■ 


.  . — 


v 

'  ;>  r  i ■ 


Let 


Then 

(3.1.3) 


<  t  <  0  ,  i.e.  t  =  -  jtl  • 


J  loge  M(t) 


loge  M(t) 


satisfies 


<  Z 


go 

<  z 

~  j*o 


_  /  -Jt|a,a^  .  -Itla2a' 

log  (ffx  e  1  1  ♦  nz  e  2 


l0«e( 


Itla2tr*  Itla,a3 

TTje  *  Tfg©  _  ^ 

Its  (a**-  a2)a3 

e 


*  _  /  Itl  a  Stfa,a^) 

<  Z  loge  (ir^  e  2  +  w2  e  1  1  / 

5=c 


+  Z  log.  e 


Stf  (ax+a2)a^ 


~  I  _  /  |tl  a  ct3  |ti  a  a^. 

<  Z  IcggCt^  e  1  ♦  tr£  e  1  ) 


0=o 


+  Z’  |tl  (ax  +  a2)a^ 

0 

OO  00 

-  Z  |t|  ax  a*J  ♦  Z  1 1 1  (ax  +  a2)a^ 

”  j"o  j=o 

It)  ai  1 t |  (ax  ♦  a2) 

1  -  a  1  -  a 
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Since  the  right  hand  side  of  (3.1.3)  is  finite,  logg  M(t) 
converges  and  hence  M(t)  also  converges  for  -»  <  t  <  0  . 
Consider  the  case 


0  <  t  < 


i.e.  t  -  it 


Then 


logg  M(t)  I  satisfies 


(3. 1*4) 


logg  M(t)  -  2  +  tt2  e 


|t!  a,a^  .  _  1 1!  axa^- 


lt|  a  flj 

2  log^  ©  1 


2  |t!  a  a3 
5 


tl  H 

1  -a 


Since  the  right  hand  side  of  (3.1*4)  is  finite,  log,a  M(t) 
converges  and  hence  M(t)  also  converges  for  0  <  t  <  00  . 
Thus  considering  (3.1*3)  and  (3.1*4)  together,  M(t) 
converges  for  -°°  <  t  <  °°  i.e.  for  finite  values  of  t  . 

In  the  case  tr^  *  ir2  s  ,  the  asymptotic  moment 
generating  function  for  the  equal  a  case  is,  therefore. 


M(t) 


w  i/  to3s* 

H  -(e  1  * 

.  2 


taJa 

e 


2) 


(3.1*5) 


9 


1  1  ,t  H  ’  tjo 


< 


f  . 


:  .  ■■  i  ,  ■ 

I  .  .  '  . 

«  .  .  ; 

-  ■  ..  ■  r:.'  ■  ■ 

:  ■  ■ 
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and  the  characteristic  function  of  the  asymptotic  distribution 
is  by  (2.3.6) 


(3.1.6)  0(t)  =  IT  |(eita5ai  +  eita;5a2) 

3«o 

where  i2  *  -1 

Since  by  (1.1.26)  and  (1.1.28)  , 


\  *  (l  -  a)Xx  and  a2  *  (l  -  a)\  , 


(3.1.7)  0(t)  »  II  +  eit(i-a)X2a^ 

j-o  2 


II  1  ^cosj(l  -  a)X1  tj+  i  sir^l  -  a)Xx  tj 

+cos^l  -  a)X2  tj  ♦  i  sinj(l  -  a)Xg  t]J- 


=  II 
3  =  o 


(1  -  a)(a^Ax  +  a^A2)t  (1- a)  (a^Ax  -  a^X2)t 

COS  "  ■  — ■  —  — - — — — -  .  cos— - — - — ■ — — 

2  2 


(l  -  a)  (a^Xx  +  a^X2  )t 
+  i  sin - - - — 


(l-a)(a4xl-  a^X2)t 

cos. — — — — - — - 


2 


2 


■  , '  ■  •  ••  •,  f  • 


.  i 


\ 


\ 
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■  XI  cos 
j“0 


(l  -  a)(g^A1 


2 


<d\)t  .  fcos  (1  -  a)(qj\i  +  alK>)t 

L  2 


+  i  sin 


(l  -  a)(a\  ♦  a^Ag)tj 


-q-  e^~(  1-a)  (^i+K2  ) 
j=o 


cos 


(l  -  a)  (a^  -  a^\2)t 


2 


itC^x+Xg) 

=  e  2 


IT  cos 
jso 


(1  -  a)(^x  "  X.g)a^  t 

2 


it^x^Xg) 


XI  cos  or 
3s® 


where  $  =  (1  -  a)  (X^  -  \  )~  . 

£ 


Thus  (3 .1*7)  gives  the  characteristic  function  of  the 
asymptotic  distribution  of  the  two  experimenter-controlled  events 
model  with  ax  ®  a2  =  a  and  with  event  E1  and  event  E2 
occurring  an  equal  proportion  of  times.  The  conditions  ffi  =  ti2  = 
and  ax  -  a2  ■  a  ,  imply  that  event  E^  and  event  Eg  occur 
equally  often  and  that  they  (e.g.  in  the  case  of  T-Maze  experiment, 
reward  and  non-reward)  have  equal  but  opposite  effects  on  behaviour. 
What  follows  in  this  section  will  be  solutions  of  the  above 
characteristic  function  for  some  special  values  of  a  . 
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(a)  Case  I.  a  *  0  ,  Xi  /  \  2  ,  tt*  *  trr2  * 


i.e.  Qi  P  **  ^1  »  Q2  p  sA2  ,  and  the  operators  are 


applied  an  equal  proportion  of  times. 

With  a  »  0  ,  the  characteristic  function  of  the 
asymptotic  distribution  (3.1.7)  bee  canes 

jt(&i+\g)  ce  , 

(3.1.8)  0(t)  ■  e  n  cos  aP(l  -  a)  (Ax  -\2)2 

it^j+Ag) 


it  (A^Ag) 
=  e  2 


1  itA,  1  it^ 
»  —  e  *  +  «•©  B 

2  2 


Thus  the  distribution  is  binomial  with  variate  values  X !  an<* 
\2  each  with  probability  |  •  Hence  if  -  1  and  X2  *  0  , 
then 


(3.1.9)  Prob.  (p  -  0)  *  1 


and  Prob.  (p  »  l)  *  i 


If  we  transform  p  to  x  «  2p  -  1  ,  it  is  the  simple  binomial 
distribution  with 


(3.1.10)  Prob.  (x  *  -l)  =  i 


2 


HIM 


_ 


1 " 


■ 


' 


*>  ■ 


Is 


N  '  <•  v'  ' 

—  -  : 


J 


5' 
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V  1 

Prob.  (x  *  1)  ■  5 

The  characteristic  function  of  the  asymptotic  distribution  of  x 
is  thus  0x(t)  *  cos  t  • 

(b)  Case  II.  a  -  1  ,  Vx  /  A2  ,  irx  ®  tr2  » 

i.e.  Qx  p  «  p  Q2  p  *  p  and  the  operators  are  applied 
an  equal  proportion  of  times. 

With  a  *  1  ,  the  characteristic  function  of  the 
asymptotic  distribution  (3.1. 7  )  becomes 

it  (Xi*Ag)  oo 

(3.1.11)  0(t)  -  e  2  H  cos  a3(l  -  a )(AX  -  \2)| 

5-o  * 

it(Ax+A2) 

-  e  2 

That  is,  the  asymptotic  distribution  is  concentrated 
at  the  point  p  =  ■"*'  with 

“1  • 

=  0  ,  then 


(3.1.12)  Prob.  (p  =  ) 

If  Ax  *  1  and  \z 


(3.1.13)  Prob.  (p 


Ml  H 


,  , 


r.  . 


.  .  ,  ~  ' 

r.  '  ,  -  , 


,  \  •  * 
1 
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If  we  transform  p  to  x  ■  2p  -  1  ,  the  distribution  is 
concentrated  at  the  point  x  ■  0  with 

(3.1.1U)  Prob.  (x  =  0)  »  1  . 


(c)  Case  III.  a  ®  i  ,  \1  /X2  ,  «  w2  -  | 


i.e.  Qi  p  =  \  p  +  (1  -  |)A1  ,  Q2  P  *  |  P  +  (1  -  §)A2  and 
the  operators  are  applied  an  equal  proportion  of  times. 

With  these  values,  the  characteristic  function  of  the 
asymptotic  distribution  (3.1.T)  for  two  experimenter-controlled 
events  bee  canes 


(3.1.15)  0(t)  -  e 


i(Ai+A2)| 


n 

jso 


cos 


£ 


!iW*  .  ,/,  z  £ 


1  2  cos  y  H  cos 

1  i*x 


2^ 


|i(A  +\2)t  gin  d  ,  x 

e  cos  ^j'  — ■ (by  [5]  page  1,  2) 


|iC\  +Ao)t 

j  (K  -X2)t  .  (A,,  -Ajt 

— — — ■  cos  — ^ — * —  .sin — i =— 

(Ajl-AsH  4  4 


4 

(ai  *  V§ 


1  VV*  trnmrn  mm  8  i 


sur 


' 


' 

■  ■ 

'  -  I"/''  1  '■  •'  '  ><■ 


’ 


r 


■ 


'  • 


;  ' 


essiober 


\ ' 


i 


j: 


B  '  • 


■ 


.  - 


. - 


t 

4 


/>  - 


4  ,  !;. 
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By  the  inversion  theorem  j|  h)  page  91,  the  asymptotic 
probability  density  function  of  the  distribution  of  p  ,  the 
probability  of  making  response  Ax  is 


(3.1.16)  f(p)  *  — - 


2ir 


«  li(\i+A2)t 


(Xl  -^2>t  -itp 
sin  . .  .  e  dt 


-  0o 


«  -j.  ^ 

1  (  [cQsOvi*Xa  -2p)g  *  i  sinCA-i+A^  - 2p )g] sin|Xi  - X2 )\ 


2tr 


C^i  -X2)f 


Since 


sin  ICXj  +  \2  -  2p)t  sin(\x  »X2)J 


is  an  odd  function  of  t  , 


(\  ~\2)f 


-  'lb 

i  j  sin  |(AX  +  X2  -  2p)t  sinQ^  -X2)p 

^  I  4- 


^1  -^2^2 


dt  -  0 


and  so 


(3.1.17)  f(p)  - 


2tt 


cos  g(\x  +  X2  -  2p)t  sin  g(Xi  -  X2)t  dt 

i(\x  -X2)t 


1 

tr 


cos  |(A.X  +  \2  -  2p)t  sin  |(\x  -\2)t 

|(Nl  “X2)t 


dt 


Since  the  integrand  is  an  even  function,  let 


y  *  2(^1  -X2)t  ,  i.e. 


(3.1.18) 


' 


-  \  " 


V- 


"  .*  a  . ;; -  '  '  v' 


* 
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2y 


Xi  -  A; 


and  dt  - 


2dy 


Hence 

(3.1.19)  f(p) 


—  ^2  ) 

o 

By  1^6}  Page  63  it  follows  that 
f(p)  «  0 


cos 


X,  .X; 


(Xl.-tAa  -  2p)y 

Xx  -  X2 


sin  y 


dy  . 


X-*i  +  X2  *  2p 

if  —  <  -1  or  >  1 

\  x  -x.s 


IT 


TT^  “  X2)  U 


if 


Xi  U2  -  2p  @  ti 


X'l  “  X_2 


.  IT 


Tf  “  X2)  2 


if  -1  <  ^ --  A'2  <  1 

"A2 


Thus 

(3.1.20)  f(p)  -  0 


2(Xi  -  Kz) 

1 


Xi  “  X  2 


if  p  >\1  or  p  > X_g 
if  p  =  \x  or  p  -■* Kz 

if  X2  <  p  <\l  . 


-  - 

-  r 

✓S  i 

1 

* '  - 

-  J  <  A 

•  >v  , 

~ 

i  ' 

:  ✓  <  t  j 

. 

... 

.  A 

A 

- 

- 

. 
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Hence  the  asymptotic  distribution  of  p  (for  »  a2  «  \  , 

Xx  /  x2  and  =  tt2  »  is  the  uniform  distribution 
f(p)  -  - i -  lying  between  the  limit  points  \  and  . 

K-K 

If  X2  =  0  f  anc^  Xx  =  1  ,  the  asymptotic  distribution  of  p 


lies  uniformly  between  0 

and  1  . 

That  is 

(3.1.21)  f(p)  -  1 

for 

0  <  p  <  1 

=  0 

for 

p  <  0  and 

This  is  shown  in  figure  3,2  .  This  result  was  obtained 
independently  by  Karlin  [2]  using  entirely  different  arguments. 


Fig.  3.2  Asymptotic  distribution  of  p  for  two  experimenter- 


controlled  events  with  ax  ■  a2  =  |  and  X1  =  1  , 
X2  3  0  • 


If  we  transform  p  to 

x  =  2p  -  1  , 

the  asymptotic  distribution 

of  x  is 

(3.1.22)  f(x)  -  1 

2 

for 

-1  <  x  <  1 

a  0 

for 

x  <  -1  and  x  >  1  . 

- 


■  ■  ' 


j  / 


■  . 


' 


j  -  A 


r  J 
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!  ... 
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This  is  shown  in  figure  3,2  . 


Fig.  3*3  Asymptotic  distribution  of  x  =  2p  -  1  for  two 
experimenter-controlled  events  with  a.  =  cu  *  - 
and  A.a  *  1  ,  \2  =  0  . 


As  a  check  on  these  results  we  compare  some  asymptotic 
moments  calculated  from  the  recurrence  formula  (1,2,7)  and 
from  the  density  function  (3.1.20)  , 

From  the  recurrence  formula  (1.2,7)  for  two 
experimenter-controlled  events  of  chapter  one,  in  general 


tt  /m>.  m-u  u  „  .  ^  /HU  m-u  u  „ 

Vm,n+i  s  ffi  2  Vax  °i  Vu,n  +  2  Va2  a2  Vu,n  * 

U-0 


m 

2 

u®o 


When  %  -  ir2  =  |  ,  aiea2®“>  the  recurrence  formula  becomes 


(3.1.23)  V 


m 


Z  (m)(arU  *  arU)(i)U+1  v 

u=o 


m,n+i  _ 'u' '  1  2  /x2/  u,n  # 


Letting  n  approach  infinity. 


^  Vm,n+i  “  Vm,« 


(3.1.2U) 


n— >«> 


'  j 


.... 

.  .  •  ,r 

c 


f  ‘  ' 
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”  C)(«ru  *  arux|)u+x  vu 

1  esA  ^ 


U®0 


Thus 


(3.1.25)  V1>t.  -  Z  (^)(ai'u  +  a^-u)(i)U4'1  V 


U“0 


11,00 


<al  *  *2>|  V0,-  +  *<l>* 


|(ai  +  a2>  +  |  \  „  » 


i.e.  -  «i  +  az 


« 


From  the  asymptotic  density  function  (3,1,20) 


Xi 

(3.1.26)  Vj.  -  (  - - E—  dp 

^  /\x  ~a2 

20^  -X2) 


Xj.  +  X  2 


2 


ai  *  a2 


r : ' 


- 


* 


r 


'  ,  /; 


-7 
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Thus  the  asymptotic  first  moment  calculated  from  the  recurrence 
formula  is  the  same  as  that  calculated  from  the  density  function. 

As  to  the  second  moment,  we  have  from  the  recurrence 

formula. 


(3.1.27)  V,  -  *  <*)(ar  ♦**'“> ( DUnV 

UcO  * 


■  (V  ♦  v><1*0,.  * 2(a* +  a*)(i)2v +  2(l)3  v= 


,09 


(a12  +  a22)  +  (ax  +  a2)2  j 


jCaj2  +  ax  a2  +  a22) 


4 ’KKz+Kz)  • 


From  the  density  function 

Ax 

(3.1.28)  V  -  (  — El_  dp 

l  K  ~K 

t 

SB  ~ 

3  (^1  “  ^  2  ) 

»  “(A^i2  +  Ax  A2  ♦  A22 )  • 

Thus  the  results  also  agree  in  the  case  of  the  second  moment* 


•>  '  ;  ■  r  ’• 

!)"  f’f  >:  (  t  .  y 


r 


1 


| 


) 


r 


■I: 


'■  1  •  . . ;■  ■  V  > 


r- 


" 


a: 


■ 
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In  general,  from  the  density  function. 


Xx 


(3.1.29) 


V  *  f 

vm,«  J 


m 


As  1  2 


dp 


_  irrn  W-l 

-Aj _ jAs— — ~ 

(m  +  1)(AX  -  X^) 

m,  m*x  m+i. 

2JSi _ r  ,«a,  J 

(m  +  l)  (ax  -  a  ) 


and  from  the  recurrence  formula. 


▼m,-  -  1  *  CK«r  * 


VLmO 


It  has  been  verified  that  for  m  -  1,  2,  the  results  obtained 
from  the  recurrence  formula  are  equal  to  those  obtained  from  the 
density  function*  Assume  that  this  holds  for  the  mth  case. 
Then  for  the  (m  +  l)th  case  from  the  recurrence  formula 


i  m+a. 


>m*lw  m*i-u  .  jra*i-uwi»u 


(3-1.30)  V  -  =  *  (  u  >(ai  *  a«1  ) (|> 


TI®0 


I  z  *  ar-*)(!)u  v 

A  uoO  * 


♦  id+iKif1  Vi,.  > 


' 


l  ' 


:  "  ”  ■;  ■ :  'i  ' . '  1  . 


r 


J 


' 


)•  " 


■  r  ■  • 


•  •  i  ;■*  i.  "  '  :Ol  Pi’ 
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i.e. 


m  ,iNu  «u,  u+i  u+i\ 

m*lw  m+i_u  m+i-Ux  (2)  2  (a,  -  a2  ) 


fl  -  (D^W.  -  ;  2  r1)(af1-U  *  af1-) 

k  y  u=o  u 


(u  ♦  l)(ax  -  a2) 


m  /„m+2 

1  2  (m+1)  (ai  ~  ag  ) 

u=o  U  (u+l)(a1-a2) 


i  m  -mil  /au+1  «m+i-u  am*-i-u  au+i 
*  l  2  C”^1)  (*1  a3  ~  ai  a2  ) 
?  u 


u»o 


(u  ♦  l)(a1  -  a2) 


1  (a?*2  -  a**2) 


(ai  -  a2) 


mti 

2  O 


u=o 


u  +  1  m  +  2 


m  mil  a^1  am+1’“u  m  -  ^m+l-U  _u+l 

+  Z  C*1)  ai  &2  _  s  (m+1)  a  a 


u»©  U  (u+l)(a1-a2)  u»o  11  (u+l)(aia.a2) 


1  (a$+2  -  ef*2) 

(al"  a2  ) 


T  C1^1)  ---  - 

uso  u  *►  1  m  ♦  2 


m 


+  2 


aU+1  am+i-u  m  ,  _m 

m+1’)  ai  a2  v  /m+l\  ai 

u  ,  _  v ,  \  “  L  Wu'  ry 


ra-u+i  _m+i-(m-u) 
a2 


H  'BM1 7  {  'i  • 

u»o  (u  +  1)  (ax  -  as)  u=o  ^(m -u)  ♦  lj  (a^  -  a2) 


In  the  last  terra,  let  v  «=  m  -  u  •  Then  when  u  »  o  ,  v  *  m 
and  when  u  =  ra,  v  ®  o  •  Thus  we  get  the  term 


m  aJ*i  am+i-v 

2  (m+1)  ~ - - “*  which  is  the  same  as  the  second  term  and 

v  v  +  1 


v=o 


so  they  cancel  to  0 


Thus 


-  70  - 


1  -  (i) 


ixin+i 


m+i  ,oo 


jmtz  m+2 

a,  -  a. 


.  a. 


Z  (  u  ) - - 

u^o  u  +  1 


m  +  2 


To  see  that 


m+i  _.n  i 

z  (r^1) 


a"*2  -i 


U®0 


u  u  +  1  m+2 


5 

r 


consider  \  (l  +  x)  dx  .  Expanding  the  integrand  by  the 
o 

binomial  theorem,  we  obtain 


(3.1.31)  (  (1  ♦  x)1®*1  dx 


1  111+1  mA.1 

2  (  1)xa  dx 

U®0  u 


(1  +  x)1^8 

m+  2 


X"1 


; 


u=o 


U  u  +  1 


X®0  N 


X“1 


'  x*o 


or 


2M+2   ^ 


m 


i  (t1)-  1 


=W - »  S-  ^  /  • 

m  +  2  uso  u  +  1 


Hence 


(1  -  ?^)v' 


'mfei  “ 

9 


„m+2 


m+2 

a2 


al  ”  a2 


2m^2  _  _ 


m  +  2  m  +  2 


and 


(3-1.32) 


m+i  ,oo  2 


af*  -  ag*2  2mf5  -  g 

ax  «  ®g  m+2 


2i+i 


JW-H 

2  -  1 


. .  ' 


'  '■  ■ 


7 ;  .  ■ 


' 
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am+2  2ra+1 
a2  m  +  2 


2ra+1 


2m+1  -  l 


2m+1  aj*-2 

m  +  2  ax 


Am+2 

a2 

a2 


Xf 2  -hTz 

(m  +  2)(\x  -  Vg) 


dp 


Thus  in  general,  the  moments  obtained  from  the  recurrence 
formula  (1.2.7)  are  the  same  as  those  calculated  from  the  density 
function  (3.1.20)  which  we  derived. 


(d)  Case  17.  a  *  p  Xi  -  1  ,  \  =  0  and  irt  »  trr2 

it 

1.1.  1 

,.e.  Qi  P  *  yP  ♦  U  -  £)  t  Q2  P  *  7JP  and  both  operators  are 


applied  equally  often. 


For  this  case,  the  characteristic  function  of  the 
asymptotic  distribution  (3.1*  1 )  becomes 


(3.1.33)  0(t)  -  eit(Ki  +  Kz)/z  rr  C03  a Sf 

j  -o 


e1#-  n  cos 

j-o  2SJ 


N|H 


r  ;■  < 


"T 


-  1 


:  ■  •  if  .'1 


<  r 


' 


\  *  . 
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where  f  -  (l  -  a)(A1  -A2)|''  „ 


The  interval  of  the  variable  p  ,  the  asymptotic 
probability  of  making  response  A1  is  given  by  the  limit  points 
\x  and  A.2  .  In  this  case  the  interval  is  (l,0)  •  For  convenience,  it 
is  changed  to  (l,-lj  by  introducing  the  variable  x  =  2p  -  1  .  The 
characteristic  function  of  the  asymptotic  distribution  of  x  is 


(3.1.3U)  0x(t)  -  E(eitx)  »  j  f(p)  eitx  dp 


\  it(2p-i) 
f(p)  ©  dp 


-it 


f(p)  e2itP  dp 


-  e 


-it 


0(2t) 


-it  it  Zr  ^  “  a^(k% 

e  •  e  II  cos  — 


3so 


223 


*  II  cos 
3*o 


3t 


2*3*  2 


~  3t  *  3t 

XI  cos  ■  vrr  •  H  cos 

.to  223+2  i=o  223*1 


n  cos 
3*0 


3t 


223+1 
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n  cos  3t 

3-1  23 

oo 

TT  o  3t 

II  cos  - 

j»o  2zi+1 


Since  by  page  1,  2 

^  n  -Z-  3t  sin  3t 

(3.1.35)  ITcos— ?»  — ; 

0=1  2J  3t 


.  .  .  sin  3t  "  •?+. 

(3.1.36)  0(t)  -  — “ "  H  sec  — -  . 

x  3t  3=0  22j+i 


Thus  the  characteristic  function  of  the  asymptotic  distribution  of 

x  is  the  term  modified  by  an  infinite  product 

3t 


3t 

H  sec 
j  =  o  223+i 


.  Let 


.  .  „  sin  3t 

(3.1.37)  0o(t)  =  , 


/ .  \  sin  3t  3t 

0  _  — —  .  sec  — 

1  3t  2 


sin 


£ 


3t 

2 


*2<‘> 


saui  sec  21.  sec  4 


3t 


23 


sin 


3t 

2 


sec 


3t 


-  7U  - 


3t 

_  sin  IT  •  cos  3t 

T  ? 


*  01  (jp  cos  3t  , 

"IT 


(t)  -  sin  3t  •  sec  3t  .  sec  3t  .  sec  3t 

~W  T  p  ? 


3t 

•!iLE  •  cos  3t  .  sec  3t 

a 

23 


F  ^ 


3t» 

sin  #  cos  3t  •  cos  3^ 


02  (|)  •  co^  ^  , 


and  in  general  let 


n 


(3.1.38)  0n(t) 


sin  3t  o  II  sec  ( 
3t 


3t 


•where  n->~ 1  , 


Furthermore  assume  that  for  the  nth  case  (  n  >  2  )  , 


(3.1.39) 


*„<*) 


^n-l  (I?  *  003  Y 

sln  n-1 


2*n-i 


X  ' 


f 


X  X 


-  7$  - 


Then  for  the  (n  +  l)th  case,  where  n  >  2 


n+i 

(3 .1.1*0)  ^(t)  -  n  sec(-2f-) 

3t  i=i  223'1 


3t 


*  !<n(t)  sec  (jsjjjj) 


3t 

sinpn=r  n-i  3t 
“ -  H  cos  “T7 

_2i_  3-1  2*3 


,  3t  \ 

sec 


22n 


-l 


3t 

sin 

IT  cos 
ji  220 

2sn+i 


t  3^ 

cos  * 


which  is  of  the  same  form  as  in  the  nth  case.  Thus  in  general 
for  n  >  2  , 


(3.1 .Ul)  0n(t)  -  ^(j)  cos  ,  and 


#  x  ,  x  sin  3t  1  /  3t  x 

0x(t)  =  lim  0n(t)  =  — —  H  sec  (^TT)  • 

n — ><»  3t  j=»i  ^ 


By  the  inversion  theorem  (UJ  page  91,  the  inversion  of 


0n(t)  into  its  density  function  is 


' 


•  • 


I  \ 

■; 


T-  •  ' 

. 


■ 

' 


. 
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(3-l.ll2)  £  j  ^(t)^  dt  -  fj 


d  ~  -itx  j  * 

In-i  U  cos  U  e  dt 


■  gn(x)  ,  say  . 


Then  by  [7]  page  63 

9 

(3 .1*143)  gn(x)  *  2 

Sn-i(luc  -  3)  * 

®n-i(^x  *  3) 

J 

By  ^  6]  page  63  , 

(3.1 .UU)  gQ(x)  -  | 

for 

-3  <  x  <  3  9 

and  ~  0 

for 

x  <  -3  and 

(3.1. U5)  gx(x)  *  j 

for 

3  3 

-2  < x  <!  - 

”  0 

for 

3 

x  <  -|  and  x 

By  (3.1.43) 

(3.1.46)  g,(x)  «  | 

2  3 

for 

9  3 

-8<X<-8  ’ 

as  0 

for 

9  3 

x  <  "I  »  ’8  < 

2  <  x  <  2  , 

8  8 

q  9 

x  <  4  and  x  >  -  , 


(3  #1.1*7)  g^(x)*~ 


-  33  2?  21  15 

f°r  ~  <  x  <  <  x  <  , 

32  32  32  32 


iS  <  x  <  21  27  33 

32  32  "32  32  * 


0 


for  x  <  -  ,  -22<x<r-Hl  , 

32  32  32 

<  x  <  <  x  <  ~  , 

32  32  32  32 


and  so  forth. 


and 


x  >  22 

X  ^  32  > 


.« 
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At  the  nth  stage,  there  are  2n“1  intervals  of  non¬ 
zero  probability  density.  Let  them  be 

(3 •l.li-8)  In  ^  where  k  «  1,  ...  2n~1  ,  and  n  >  1  • 

For  example,  for  n  3  ,  there  are  four  intervals 


(3.1.1i9)  I3>1  *  (-32  ,  )  I3j3  !  (  %  >  |  } 


3,2 


,  ( Ji  ,  JS.  ) 

32  32 


1  -  (21  22 

3,1*  1  32  ’  32  ' 


Each  such  interval  ^  at  stage  n  generates  two 
new  intervals  at  stage  (n  +  l)  in  the  following  manners 
divide  3^^  into  ei^xfc  equal  subintervals  ...  g 

from  left  to  right;  discard  irikj]  ,  and  i^g  . 

Then  the  two  new  intervals  consist  of  the  union  of  inkj2  »  ^nks3 
and  the  union  of  ^  ,  and  .  The  probability  distribu¬ 

tion  at  the  (n  ♦  l)th  stage  is  then  obtained  by  constructing, 
over  the  new  intervals,  identical  rectangles  of  height  double  that 
of  the  preceding  stages  as  shown  in  figure  3.U  .  From  this 
construction  it  follows  that  if  Wn  and  h^  are  respectively 
the  width  and  height  of  a  rectangle  at  the  nth  stage,  then 


(3.1.50)  wn 


(3.1.51)  U 


2z(n-i) 

3 


n  >  1 


n  >  1 


The  total  width  of  the  intervals  at  stage  n  is 


. 


78 


it 


n) 

II 

£ 


C  ^  tzz 


K 

^  v-c 


r<\ 

(• 


W 


M 

J5 


CO 


♦  rc 

»<c 


C'- 


vO 


<! 

V\ 


«=J 


■Q 

Cvi 


v\ 

i 


/O 

*i 

js! 


Kc 


O 

'V 


(I 

ii 


•I 

£ 


Fig.  3.U  Distribution  gjj(x)  for  n  ■  1,  2,  3,  and  U 
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(3.1.52)  Wn 


3 

22(n-i) 


Thus  as  n  approaches  infinity,  Wn  approaches  0  , 
and  hence  the  probability  is  concentrated  on  a  set  of  points  of 
Lebesgue  measure  0  .  The  close  analogy  between  the  construction 
described  above  and  that  of  the  Cantor  Ternary  set  suggests  that 
the  asymptotic  distribution  is  concentrated  on  a  nonenumerable 
set  of  points  of  Lebesgue  measure  zero  and  that  the  cumulative 
distribution  function  is  a  continuous  increasing  function  which 
is  not  an  integral  ([8]  page  329  and  page  366).  Figure  3.5 
shows  the  cumulative  distribution  G^(x)  for  n  -  3  and  n  *  U  • 


(e)  Case  V:  a  «  =  0,^*1,  ti^  "  tr2 


That  is  Qi  p  *  “7S  P  ♦  (1  -  — )  and  Q2  p  s  —  p  ,  and  both 
V2  y/2  \/2 

operations  occur  equally  often. 


With  a  »  —  ,  the  characteristic  function  of  the 

y/2 

asymptotic  distribution  (3.1.7  )  becomes 


(3.1.53) 


it(^i+X2) 
0(t)  *  e - 


n 


aj(l  -  a)(Ax  -  Kz)t 

cos  - —  ■'  — 

2 


=  n  cos  k-Z-a&fe. 

0*0  2+1 

Using  the  same  transformation  as  in  the  previous  case,  let 
x  =  2p  -  1  .  The  characteristic  function  of  the  asymptotic 
distribution  of  x  following  the  same  procedure  as  in  (3.1.3U)  is 


Hid 


-  80  - 


Fig.  3.£.  Cumulative  distribution  C^(x)  for  n  s  3  and 
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(3.1.#)  0x(t)  -  e-11  0(2t) 


-It  it  Zr  (1  -3*)t 

5  •  e  XI  cos 


j»o 


37a 


n  cos  (i  -  5?)t 
0V2 


=  n  cos 

3=0 


(\/2  -  l)t 

Cj+1^/2 


X  (V2  -  l)t  .  ^  (V?  -  l)t 

3s©  (V^)2^  2  jso  (V?)2^1 


and  by  {$]  page  1,  2 


/.X  sinCV^  -  l)t  sin(2  -  y/2) t 
x  (\/2  -  l)t  (2  -  \/?)t 


sin(v^  -  l)t 

which  is  the  product  of  the  term  ““ - — — —■  and  the  term 

(>/?  -  Dt 

sin(2  -  yJS)t 

(2  V?)t  *  Xhe  first  term,  by  the  same  inversion  method  as 

used  in  (3.1.16)  ,  (3.1.17)  ,  (3.1.18)  ,  (3.1.19)  ,  is  the 

characteristic  function  of 


(3.1.#)  f(x) 


2(\£  ~  1) 


for  -(v*  -  1)  <  x  <  ts/2  -  1) 


0 


for  x  <  -(\/?  -  l) 


x  >  (y/S  -  l) 


S' 
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Similarly,  the  second  term  is  the  characteristic  function  of 


(3.1.56)  f(x)  -  - - -  for  -v^(V2  -  1)  <  x  <  \/2(\/2  -  l) 

2y/2(y/2  -  l) 

*  0  for  x  <  [2  -  l)  and  x  >  \/2(\/2  -  l) 

Thus  ^(t)  is  the  characteristic  function  of  the  convolution 
(  [9]  page  2£o)  of  the  distributions  (3.1.55)  and  (3*1*56)  ® 

To  invert  (3.1.5U)  into  the  distribution  function,  consider  the 
more  general  case 

(3.1.57)  where  a>b  . 

at  bt 


This  is  the  characteristic  function  of  the  convolution  of  the 
distributions 


(3.1.58)  ga(y)  *  ~ 

a  0 

and 

(3.1.59)  gb(y)  * 

=  0 


for  -a<  y  <  a 

for  y  <  -a  and  y  >  a 

for  -b  <  y  <  b 

for  y  <  -b  and  y  >  b 


The  convolution  of  ga(y)  and  gb(y)  is 

00 

(3.1.60)  f(x)  -  J  ga(y)  gb(x  -  y)dy  . 


To  obtain  the  limits  of  integration  figure  3*6  is  drawn 


_ 


.  '« 

.  * 

■ 

* 


.  ' 
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and  gb(y)  where  ga(y)  =  for  -a  <  y  <  a  , 

g  (y)  *  0  otherwise  and  gb(y)  ■  i-  for 
a  2b 

-b  <  y  <  b  ,  gb(y)  *  0  ,  otherwise. 


From  figure  3.6 


(3.1.61)  f(x) 


x+b 

f 


2a 


1 

Uab 


1  ,  x  +  a  +  b 

2b  dy  ‘  ~  ab~ 


-a 


1 

Uab 


x+b 

f 


x-b 

a 


.  1 
dy  = 


tzz  dy 


x-b 


a  *■  b  -  x 

Uab 


for  »(a  ♦  b)  <  x 


for  -(a  -  b)  <  X 


for  (a  -  b)  <  x 


for  x  <  -(a  +  b)  and  x  >  (a  +  b) 


<  -(a  -  b)  , 


<  (a  -  b)  , 


<  (a  +  b)  , 


In  the  characteristic  function  (3*1*5>U)  considered  above. 


-  8U  - 


a  =  2  -  yj2  ,  b 
Thus 

(3.1.62)  f(x)  = 


V&  -  1  ,  and 


1  +  x 

kj2(y/2  -  l)2 

1 

2yj2{y/2  -  l) 

1  -  x 


bj2{\f2  -  l)2 


a  ♦  b  =  1  ,  a  -  b  =  3  -  2yj2  . 


for  -1  <  x  <  -(3  -  2 \J2) 


for  -(3  -  2v^)  <  x  <  3  -  2V? 


for  3  -  2 y/2  <  x  <  1 


-  0 


for  x  <  -1  and  x  >  1  . 


This  distribution  is  shown  in  figure  3.7  . 


Fig.  3.7.  Asymptotic  distribution  of  x  =  2p  -  1  for  two 
experimenter-controlled  events  with  ai  =  a2  = 
\2  =  0  ,  \i  «  1  and  tti  *  it2  =  |  • 


Since  x  *  2p  -  1  ,  the  corresponding  asymptotic  distribution  of 
p  is 


■  ■  ;  V 
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(3.1.63)  f(p)  *  - * - 

Wy/2  -  l)2 


for  0  <  p  <  yfZ  -  1 


1 

y/2(y/2  -  1) 

1  -  P 

v£(V 2  -  l)2 


for  \/2-l<p<2-\/2 


for  2  -  <  P  <  1 


This  is  shown  in  figure  3.8  . 


Fig.  3.8.  Asymptotic  distribution  of  p  from  two  experimenter- 
controlled  events  with  01*02®  ,  \2  ®  0  , 

■  1  and  irx  «  ir2  *  \  . 

To  summarize  this  section,  let  us  recapitulate  the 
evolution  of  the  distribution  of  x  =»  2p  -  1  as  a  ranges  from 
0  to  1  with  \x  *  1  and  A2  *  0  .  For  a  =  0  ,  the  distribu¬ 
tion  is  binomial  at  x  =  -1  and  at  x  =  +1  each  with  probability 


MIH 
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For  a  =  —  ,  the  distribution  is  concentrated  on  a  nonenumerable 
set  of  points  of  Lebesgue  measure  zero.  For  a  =  |  ,  the 
distribution  is  uniform  from  -1  to  +1  with  density  function 
f(x)  ■  i  .  For  a  *  ~  ,  the  distribution  density  function 

2  \J2 

increases  in  value  as  x  increases  from  -1  to  -(3  -  2\/?)  , 
becomes  uniformly  distributed  until  x  *  (3  -  2 \/?)  ,  and  then 
decreases  to  0  as  x  increases  to  1  .  For  a  *  1  ,  the 
distribution  is  entirely  concentrated  at  the  point  x  ■  0  •  From 
these  results,  it  appears  that  the  density  function  of  the 
asymptotic  distribution  tends  to  concentrate  towards  the  centre, 

1  Hh 

from  the  value  5  at  x  s  „1  when  a  =  0  until  finally  the 
density  function  concentrates  at  the  middle  point  x  ®  0  when 
a  *  1  .  Karlin,  S.  in  points  out  that  for  0  <  a  <  |  , 
the  distribution  is  on  a  Cantor-like  set  of  points  and  conjectures 
that  for  1  >  a  >  i  ,  the  cumulative  distribution  becomes  con- 
tinuous . 


Section  Two 


From  chapter  two  equation  (2.3.3)  the  moment  generating 
function  of  the  distribution  of  p-values  for  two  subject-controlled 
events  in  the  equal  a  case  on  the  nth  trial  is  given  by  the 
following  functional  differential  equation 

t&2  d 


Mn+i  (t)  “  e  &2  Mr/0*)  *  “ - 


a 


~  M  (at) 
dt  n 


and  the  asymptotic  moment  generating  function  satisfies  (2.3.U) 


;  ■ 


■ 

■ 


. 

;  :  ■  ioo  "  C  . ;  -  . : 

...  ■ 


‘ 


■  , 


, 


■ 


•  * 
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x  ptai  _  eta2 

M(t)  *  eta2  M(at)  +  - - 5 - 

a 


—  M(at)  . 
dt 


Attempts  have  been  made  to  solve  the  above  functional  differential 
equations.  However,  so  far,  no  explicit  solution  has  been  obtained. 
Only  certain  properties  of  the  functional  differential  equations 
in  the  case  a  ,  Ax  *  0  ,  X.2®1  (i.e.  Qx  P  ■  g  p  and 

Q2  P  15  §  P  *  |)  have  been  obtained  and  we  consider  these  in  the 
subsequent  remarks. 

/  V  «  1 

(a)  By  substituting  a  *  -  into  the  moment  generating 
functional  differential  equation  (2.3.3)  on  the  (n  ♦  l)th  trial 


(3.2.1)  Mn+X(t) 


t/a 


M„(t/2) 


1  -  e 


t/2 


1/2 


—  Mn(t/2) 

dt 


Since  as  stated  at  the  end  of  section  three,  chapter  one,  the 
asymptotic  p-values  in  this  case  are  independent  of  the  initial 
p  value  ,  we  may  take  P0  38  |  for  convenience. 


Thus 

(3.2.2) 


M0(t) 


t/2 


Mj,(t) 


t/2 

et/2  M  (t/2)  +  1"~  *—  ~  «0(t/2) 
0  1/2  dt 


1  tA  1  t3/u 

2  2 


t/2 

t/2  M  (t/2)  *  '  -  Ml(t/2) 

1  1/2  dt 


Mg  (t)  *  e 


1/2 


'  :  '  »  '  '  :  ■  .  -  <  •  9 r&  i  •  m  \ 

. 

. 


.  * 


■ 


' 

. 


s  : 

- 


- 


;  ■■  * 

•  ' 


4 


f!  ■ 


- 


.'l 
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1  et/8  *  2  et3/8  *  2  et3/8  *  i  e^8 

8  8  8  8 


and  similarly 


t/2 


l-et/2  d 


Mj(t)  -  e  H2(t/2)  +  — -  —  Mg  (t/2) 


-i  et/16  ♦  _2  et3/l6  ♦  2S  et?/l6  ♦  -I  et?/l6 
6U  6U  6U  6U 


+  _I  et?/l6  ♦  15  etn/l6  *  _9  et13/l6  +  _1  etlS/l6 
6U  6U  6ij  6U 


Let  the  values  of  p  on  the  nth  trial  be  arranged  in  increasing 
order,  and  let  fn(pr>n)  be  the  probability  of  the  rth  value  of 
p  on  the  nth  trial  given  by  the  coefficient  of  e^Prn  in  the 
moment  generating  function.  From  the  above,  for  any  n  , 

2n 

(3.2.3)  Vt)  =  2  fn(Pr,n)e' tPm 

r~l 


where 


and 


(3.2.U) 


2r  -  1 
Pr,n  =  2n+i 


2nn 


(r  s  1,  ...  2n)  f 


tp. 


Vi(t)  ■  2  Vi(Pr,OT)'  r’"*1 

r 


where 


2r  -  1 

3r,n+i  “  9n+2  9 


(r  =  1,  ...  2n+1)  . 


Using  (3.2.1) 

•WiW  -  et/2  Mn(t/2)  ♦  2(1  -  e*/2)  Mn(t/2) 


9 
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we  obtain 


t/2 


„n  t(2r-l) 

2  “TTI T5 — 


(3.2.^)  M^Ct)  -  e  7  S  fn(Pr,n)e 

r*=l 


>n 


t(2r-l) 


r-1  n  r’“  211*1 


.n 


jx  Pr,n  fn(Pr#n)«tPr,Dtl 


.  ?  r  f  i  (2n+1  -  2r  +  1) 

♦  2  f  (pr  _)  — —  e 

-■>  n  r>n  2n+i 


t(2n^1  ♦  2r  -  1) 


5T1+2 


r-’l 


In  the  second  sum  let  R  *  2n  +  r  •  Then 


.n 


2  =^p 

(3.2.6)  Vi(t)  *  2  Pr.n  fn(Pr,n)e  r’n*1 

rel  9 


.n+i 


+  fn(Pp  on  n 

Rs2n+1  Rl  *n 


tfc-l) 

)  (2n  S  -  2R  *  1) 

„n+i 


\  Pr,n  *n(Pr,n>«tPr,nfl  +  \  /n(Pr-2n,n>^^e^ 


xH+1 


r=l 


r»2  +1 


Comparing  (3.2.4-)  and  (3.2.6)  ,  we  see  that 

(3.2.7)  fn+i(Pr,n<-i)  "  Pr,n  fn(Pr,n)  for  1  <  r  <  2n 

(3.2.8)  fn+1(pr,n+i)  -  P  n+1  f„(P  n  )  for  2n  *  1  <  r  <  21*1  . 

d  -r+l,n  T-d  ,n 

Prom  (3.2.7)  and  (3.2.8)  ,  table  3.1  is  constructed  for 

x*0,l,2,3,U.  It  is  obvious  from  the  table  that  the  distribution 
is  symmetrical  for  all  values  of  n  . 


J  ~ 


. 


' 


.  :  •  1  ■ 

"  hi'.. 


r; 


( .  1 . 


.... 


m  - 


- "  • 


■ 
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Table  3.1*  Values  of  ^n^Pr,n^  ^or  n»0,  1,  2,3,U.  The 
values  in  each  column  of  fn(pr >n)  in  the  table 

divided  by  the  corresponding  2n^n+1 give  the 
probabilities  of  the  p  values  on  the  nth  trial. 
As  this  is  a  two  subject-controlled  event,  there  are 


2n  possible 

p  values 

on 

the  nth  trial 

» 

*n(Pr.n> 

n 

0 

1 

2  3 

k 

2n(nti)/2 

r 

numerator 
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It  can  be  seen  from  the  table  that  the  (2n“1)th  and  (2n~'1'  +  l)th 


,n-i 


p  values  on  the  nth  trial  always  have  a  probability  of 

2(2n”1)  -  1  „ 

f  '  \  / —  •  Since  there  are  2n  p-values  on  the  nth  trial 

2n(n+i)/2  * 

and  they  are  equally  spaced,  we  can  consider  the  unit  interval  as 

divided  into  2n  equal  subintervals.  For  example  for  n  «  3  , 

2n  *  8  and  this  is  shown  in  figure  3.9. 


Fig.  3.9.  Histogram  of  P  ^  where  r  •  1,  2,  3,  U,  5,  6,  7,  8. 


The  width  of  each  subinterval  is  “  .  Since 


Probability  ®  probability  density  x  width  of  interval, 
we  have  for  r  ■  211”1 


(3.2.9) 


2(2n**1)  -  1 

0n(n+i)/2 


prob.  density  x  — 

2n 


or 


2nf2n  -  1J 

(3.2.10)  Prob.  density  of  p  n  -  *  : 

2n  %n  2 


(2  -  1) 

n(n+i)/2 


22n 


-  2n(n+i)/2 
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Thus  as  n  approaches  infinity, 


(3.2.11) 


lim  p  <  lim 

n — >oo  2  "  ,n  n— >» 


22p 

2n(n+i)/2 


—  >  0 


Similarly  the  probability  density  of  p  also  approaches 

2n“1+l,n 

0  as  n  approaches  infinity.  Thus  in  the  asymptotic  distribution 

the  probability  density  of  p  s  ~  is  zero.  The  table  itself 

suggests  the  conjecture  that  in  the  asymptotic  distribution  the 

maximum  lies  at  p  =  -  and  at  p  **  -  .  Dr.  T.  V.  Narayana  (lO) 

3  3 

has  devised  a  convincing  argument  that  this  is  so.  From  the  above 
results,  it  is  likely  that  the  asymptotic  distribution  is  of  the 
shape  shown  in  figure  310. 


Fig.  310.  The  conjecture  of  the  asymptotic  distribution  of  two 
subject-controlled  events  with  ai  «  02  »  -  and 
X1  *  0  and  \2  •  1  . 


The  shape  of  the  curve  of  figure  3.10  is  in  close  agreement  with 
the  result  obtained  by  R.  R.  Bush  and  F.  Hosteller  in  (l)  page  138, 


:  ■■  r  •  • 

.  i  ~ 

, 


. 


j  - 


JO  ,  - 

-  - 


- 


with  a  2000-trial  stat  rat.  Fig.  3 .11  is  a  reproduction  of  their 
work. 


Fig.  3.11.  The  approximate  asymptotic  cumulative  distribution  of 
p  values,  obtained  from  a  2000  trial  stat  rat,  for 
the  case  of  two  subject-controlled  event  with 
Qa  p  =  0.5p  and  Q2  p  *  0.5  +  0.5>p  .  The  straight 
line  corresponds  to  a  uniform  distribution  from  zero 
to  unity.  (Reproduced  from  [l]  page  138 ) 


From  figure  3*1^  the  approximate  cumulative  curve  appears  to  be 

i  i 

symmetrical  about  p  ~  -  and  at  p  *  -  ,  it  appears  to  have  a 

slope  equal  to  zero,  furthermore,  it  appears  that  at  p  *  - 

2  3 
and  at  p  ,  the  cumulative  curve  is  at  a  point  of  inflexion 

3 

respectively.  Thus  it  appears  that  the  probability  density 

distribution  curve  has  a  maximum  at  p  =  i  and  another  one  at 

8  3 
p  *  -  respectively.  This  is  in  agreement  with  the  result  obtained 

3 

above  from  the  consideration  of  the  moment  generating  functional 
equation.  From  equation  (1.3*7)  the  mean  of  the  asymptotic 


distribution  is 


f  to"  ' 


. 


■  •p"  '  •  •  '  t 


•:> 


■ 


'  v.'.:  r:  ' 


> 


X.  . 

v,l  \ 
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'  '  ' 
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1  -  a 


(3.2.12)  V  -  -  -  - ; - - 

1»  1  -  ax  ♦  a2  -  a  1  -  (2a  -  l) 


and  from  equation  (1.3.15)  ,  the  variance  of  the  asymptotic 
distribution  is 


(3.2.13)  tf2  =  V2  w 


a22  ♦  Bj,  Vx 


£.  -  V. 


1  -  B, 


X,00 


1  -  a(3a  -  2) 


(1  -  a)2  ♦  (1  -  g)2(3a  -  1) 


1  -  (2a  -  1)  J 


-  ( 


1  +  a 
2(1  +  3a) 


(i)2 

2 


1  ‘  I 


U(1  +  3/2) 


-  0.05  , 


so  that  <f  *  0.2236 


The  values  obtained  from  the  single  stat-rat  computation  were 
V,  ■  O.U958  and  <T  »  0.222?  . 

A  j®  00 

(b)  The  characteristic  function  of  the  asymptotic 
distribution  is  from  (2.3.9)  given  by  the  equation 


HIM 


t 


' 


- 


* 


» 
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0(t)  .  eita2  0(t/2)  -  21  (eitai  -  i-  0(t/2)  . 

dt 

Since  in  this  case  X  *0,\2*lf  we  have  ax  =  0  and 
a2  »  |  .  Substituting  ax  -  0  ,  *=  i  and  t  by  2t  ,  the 

characteristic  function  becomes 


0(2t)  »  0(t)  -i(l-  e11)  fL  0(t)  ,  or 

dt 


(3.2.1k) 


1  -  e14 


0(2t) 


To  transform  the  asymptotic  p-distribution  interval  from  ^0,l} 
to  j -l,l)  let  x  *  2p  -  1  where  -1  <  x  <  1  •  As  in  (3.1.3U) 
0„(t)  ,  the  characteristic  function  of  the  asymptotic  distribution 
of  x  is  equal  to 

0x(t)  -  ei-fc  0(2t)  ,  or 

0(t)  =  e1'2  0x(t/2)  . 


Thus  the  differential  equation  satisfied  by  0x(t)  is  from 
(3.2.110 

(3.2.15)  2(1  -  e**)  ^  0x(t/2)  +  i(l  +  e1^)  0x(t/2)  =  2±e±t:^  0x(t)  . 


For  convenience  let  t  *  2©  ,  then  (3.2.15)  becomes 


'  1  »  =:  ’  '• 

' 

ciSWJO”  -K 


j 


. 


1 
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(3.2.16)  (1  -  e2*9)  rf  ( 9)  +  i(l  +  e2*-9)  |Zf  (©)  -  21«ie  rt  (29) 

d©  x  X  X 

l(e-i9  -  e19)  ±-  0^(0)  ♦  (e-«  ♦  e19)  tf(9)  -  2{L(29)  .  or 
i  d0  x 

(3.2.17)  cos  9  •  J2fx(0)  -  sin  0  ~  4(9)  «  4(20)  . 

An  attempt  was  made  to  solve  this  functional  differential 
equation  by  the  Fourier  series.  However,  the  odd  coefficients  of 
the  series  are  obtained  only  in  the  form  of  a  recurrence  equation 
which  I  have  not  been  able  to  solve. 

From  remark  (l)  ,  it  has  been  shown  that  the  distribution 
is  symmetrical  about  the  centre  and  so  0X(@)  must  be  an  even 
function.  Thus  let 


(3.2.18)  4(0) 


”  +  2  cos  n9  , 

2  r=l 


where  ^  and  an  (n  -  1,  2,  ...  ®)  are  constants  of  the  Fourier 
cosine  series.  Substituting  this  into  the  differential  equation 

(3.2.17)  , 


(3.2.19) 


cos  0 


+ 


Z  an  cos  n0 
n«l 


+  sin  0 


Z  an  n  sin  n0 
n»l 


00 

Z  an  cos  2n0 
n»l 


♦ 


\ 


' 


\ 


fi  l  £ 
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This  functional  differential  equation  is  equal  to 


a. 


—  cos  9  +  2  a«  cos  9  cos  n9  +  2  n  a„  sin  9  sin  n0 

2  n-1  n-1  " 


a. 


■=  —  +  2  ajj  cos  2n9  ,  or 

2  n=l 


GO  v 

(3*2. 20)  ^2  cos  9  ♦  2  |  fcos(@  +  n9)  +  cos  (9  -  n9)  j 


n-1 


00  % 
2  na^  if  cos (9  -  n9)  -  cos(9  +  n9)j 
n-1  ~  *• 


♦  2'  a_  cos  2n9  • 

2  n-1 


Consider  the  even  coefficients.  Let  n  -  2k  where  k  -  1,  2,  3,  •••  ♦ 
Equating  the  coefficients  of  the  cosines 


(3.2.21)  a2k  |(1  -  2k)  cos (2k  +  1)0  +  a2k*2  |(l  +  2k  +  2)  cos  (2k  +  l)@ 

i.e. 


(3.2.22)  a2k(l  -  2k)  +  a2k+2(2k  +  3)  «  0  ,  or 


a2k*3 


2k  ->  1 
2k  +  3 


a2k  • 


Thus  by  (3.2.22) 


....  •  A  f,  ;* 


- 


■  *  -  it 


-- 
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2k  +1  2k  -  1 


•  a, 


o 


_  a 


o 


(2k  +  l) (2k  -  1) 

Equating  the  coefficients  of  cos  2n©  of  (3.2.20) 

a2n-x(l  "  n)  cos  2n@  *  a2n+i^n  *  ^  cos  2n9  s  ®n  cos  2n®  or 

(3.2 ,2U)  ~  a2n-x^  “  +  a2n+x^  +  * 


Thus  the  odd  coefficients  are  given  by  the  recurrence  relation 


an  -  a2n-i(l  -  n) 


(3.2.2£)  a2n+i  *• 


1  *  n 


Attempts  have  been  made  without  success  to  solve  this 
recurrence  equation, 

(c)  By  (3.2.17)  the  functional  differential  equation 
satisfied  by  the  characteristic  function  of  the  asymptotic  distribution 
of  x  •  2p  -  1  is 
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This  functional  differential  equation  may  be  simplified  by  the 
substitution 


(3.2.26)  0X(9)  -  sin  ©  g^©)  , 


so  that 


(3.2.27) 


d© 


cos  ©  gx(@)  +  sin  0 


d  ggO) 
d© 


yielding 

(3.2.28)  -  — — -  -  -2  cot  ©  ^(2©)  . 


Attempts  have  been  made  to  solve  the  functional  differential 
equation  in  this  form.  However,  they  have  not  been  successful. 
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